Sep 09 14:32:33 devstack cinder-volume[76349]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 14:32:33 devstack cinder-volume[76349]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 14:32:33 devstack cinder-volume[76349]: we strongly recommend against using it for new projects. Sep 09 14:32:33 devstack cinder-volume[76349]: If you are already using Eventlet, we recommend migrating to a different Sep 09 14:32:33 devstack cinder-volume[76349]: framework. For more detail see Sep 09 14:32:33 devstack cinder-volume[76349]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 14:32:33 devstack cinder-volume[76349]: import eventlet # noqa Sep 09 14:32:36 devstack cinder-volume[76349]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76349) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:32:36 devstack cinder-volume[76349]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76349) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:32:36 devstack cinder-volume[76349]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76349) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:32:37 devstack cinder-volume[76349]: INFO dbcounter [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Registered counter for database cinder Sep 09 14:32:37 devstack cinder-volume[76349]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76349) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:32:37 devstack cinder-volume[76349]: DEBUG dbcounter [-] [76349] Writer thread running {{(pid=76349) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 14:32:37 devstack cinder-volume[76349]: INFO cinder.rpc [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 14:32:37 devstack cinder-volume[76349]: INFO cinder.rpc [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 14:32:37 devstack cinder-volume[76349]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76349) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:32:37 devstack cinder-volume[76349]: INFO cinder.volume.manager [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Determined volume DB was empty at startup. Sep 09 14:32:37 devstack cinder-volume[76349]: DEBUG cinder.volume.manager [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76349) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 14:32:38 devstack cinder-volume[76349]: INFO cinder.volume.manager [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 14:32:38 devstack cinder-volume[76349]: WARNING stevedore.named [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 14:32:38 devstack cinder-volume[76349]: WARNING castellan.key_manager [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:32:38 devstack cinder-volume[76349]: WARNING cinder.keymgr.conf_key_mgr [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG cinder.volume.drivers.lvm [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76349) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_concurrency.processutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76349) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_concurrency.processutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] CMD "cinder-rtstool verify" returned: 0 in 0.377s {{(pid=76349) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76349) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:32:38 devstack cinder-volume[76349]: INFO cinder.rpc [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 09 14:32:38 devstack cinder-volume[76349]: INFO cinder.rpc [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 09 14:32:38 devstack cinder-volume[76349]: WARNING stevedore.named [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 14:32:38 devstack cinder-volume[76349]: WARNING castellan.key_manager [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:32:38 devstack cinder-volume[76349]: INFO cinder.volume.manager [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76349) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:32:38 devstack cinder-volume[76349]: INFO oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Starting 1 workers Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Started child 76495 {{(pid=76349) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Full set of CONF: {{(pid=76349) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] ******************************************************************************** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Configuration options gathered from: {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] ================================================================================ {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] allow_availability_zone_fallback = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] allow_compression_on_image_upload = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] allowed_direct_url_schemes = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] api_rate_limit = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76495]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] auth_strategy = keystone {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] az_cache_duration = 3600 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_availability_zone = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_host = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_stats_polling_interval = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backup_api_class = cinder.backup.api.API {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backup_name_template = backup-%s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backup_use_same_host = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backup_use_temp_snapshot = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] chap_password = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] chap_username = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_internal_tenant_project_id = e1a1690bfc0e4cb09463a4c4400d9c24 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_internal_tenant_user_id = c714851e14f644a8897feb2507567a3f {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cloned_volume_same_az = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cluster = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] compression_format = gzip {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] compute_api_class = cinder.compute.nova.API {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] config_dir = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] config_source = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] control_exchange = openstack {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] debug = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] default_availability_zone = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] default_group_type = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] default_volume_type = lvmdriver-1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] disk_geometry = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] driver_client_cert = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] driver_client_cert_key = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] driver_data_namespace = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] driver_ssl_cert_path = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] driver_ssl_cert_verify = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] driver_use_ssl = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] enable_force_upload = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] enable_new_services = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] enable_unsupported_driver = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] enforce_multipath_for_image_xfer = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] filter_function = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_api_insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_api_servers = ['http://192.168.122.73/image'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_api_ssl_compression = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_ca_certificates_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_catalog_info = image:glance:publicURL {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_num_retries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance_request_timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] goodness_function = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] graceful_shutdown_timeout = 5 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] group_api_class = cinder.group.api.API {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] host = devstack {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_compress_on_upload = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_conversion_address_space_limit = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_conversion_cpu_limit = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_conversion_disable = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_upload_use_cinder_backend = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_upload_use_internal_tenant = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_volume_cache_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_volume_cache_max_count = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] image_volume_cache_max_size_gb = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] init_host_max_objects_retrieval = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] instance_format = [instance: %(uuid)s] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] iscsi_target_flags = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] iscsi_write_cache = on {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] iser_helper = tgtadm {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] iser_ip_address = 192.168.122.73 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] iser_port = 3260 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_color = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_config_append = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_dir = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76495]: INFO cinder.volume.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_options = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_rotate_interval = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_rotate_interval_type = days {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] log_rotation_type = none {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] max_age = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] max_logfile_count = 30 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] max_logfile_size_mb = 200 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] max_over_subscription_ratio = 20.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] message_reap_interval = 86400 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] message_ttl = 2592000 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] migration_create_volume_timeout_secs = 300 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] monkey_patch = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] monkey_patch_modules = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] my_ip = 192.168.122.73 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] no_snapshot_gb_quota = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] num_iser_scan_tries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] num_shell_tries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] num_volume_device_scan_tries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] nvmeof_conn_info_version = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] nvmet_ns_id = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] nvmet_port_id = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_max_limit = 1000 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_volume_ext_list = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_volume_listen_port = 8776 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_volume_use_ssl = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] osapi_volume_workers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] per_volume_size_limit = -1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] periodic_fuzzy_delay = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] periodic_interval = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] public_endpoint = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] publish_errors = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_backup_gigabytes = 1000 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_backups = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_gigabytes = 1000 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_groups = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_snapshots = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] quota_volumes = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] rate_limit_burst = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] rate_limit_except_level = CRITICAL {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] rate_limit_interval = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] reinit_driver_count = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] replication_device = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] report_discard_supported = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] report_interval = 120 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] reservation_clean_interval = 86400 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] reservation_expire = 86400 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] reserved_image_namespaces = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] reserved_percentage = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] rpc_response_timeout = 120 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] run_external_periodic_tasks = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] scst_target_driver = iscsi {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] scst_target_iqn_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_down_time = 720 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] shell_completion = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] snapshot_name_template = snapshot-%s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] snapshot_same_host = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] split_loggers = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] state_path = /opt/stack/data/cinder {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] storage_availability_zone = nova {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] storage_protocol = iSCSI {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] syslog_log_facility = LOG_USER {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] target_helper = lioadm {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] target_ip_address = 192.168.122.73 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] target_port = 3260 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] target_protocol = iscsi {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] target_secondary_ip_addresses = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] trace_flags = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] transport_url = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] until_refresh = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_chap_auth = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_default_quota_class = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_journal = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_json = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_multipath_for_image_xfer = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_stderr = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] use_syslog = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] verify_glance_signatures = enabled {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_api_class = cinder.volume.api.API {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_backend_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_clear = zero {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_clear_ionice = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_clear_size = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_copy_bps_limit = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_dd_blocksize = 1M {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_name_template = volume-%s {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_service_inithost_offload = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volume_usage_audit_period = month {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] zoning_mode = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_concurrency.disable_process_locking = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.auth_section = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.auth_type = password {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.auth_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.cache = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.include_service_catalog = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.interface = public {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_password = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcache_username = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.region_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.service_type = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.73/identity {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.backend = dogpile.cache.null {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.backend_argument = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.backend_expiration_time = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.config_prefix = cache.oslo {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.debug_cache_backend = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.enable_retry_client = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.enable_socket_keepalive = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.expiration_time = 600 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.hashclient_retry_attempts = 2 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_dead_retry = 300 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_pool_maxsize = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_sasl_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.password = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.proxies = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.redis_db = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.redis_server = localhost:6379 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.retry_attempts = 2 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.retry_delay = 0.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.socket_keepalive_count = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.socket_keepalive_idle = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.socket_keepalive_interval = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.socket_timeout = 1.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack sudo[76500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.tls_allowed_ciphers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.tls_cafile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.tls_certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.tls_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.tls_keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cache.username = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] coordination.backend_url = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack sudo[76500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.asyncio_connection = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.asyncio_slave_connection = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.backend = sqlalchemy {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.connection = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.connection_debug = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.connection_parameters = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.connection_recycle_time = 3600 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.connection_trace = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.db_inc_retry_interval = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.db_max_retries = 20 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.db_max_retry_interval = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.db_retry_interval = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.max_overflow = 50 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.max_pool_size = 5 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.max_retries = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.mysql_wsrep_sync_wait = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.pool_timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.retry_interval = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.slave_connection = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.sqlite_synchronous = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.synchronous_reader = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] database.use_db_reconnect = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_tracing.insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.connection_string = messaging:// {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.es_doc_type = notification {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.es_scroll_size = 10000 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.es_scroll_time = 2m {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.filter_error_trace = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.hmac_keys = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.sentinel_service_name = mymaster {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.socket_timeout = 0.1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.trace_requests = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler.trace_sqlalchemy = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler_jaeger.process_tags = {} {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler_jaeger.service_name_prefix = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] profiler_otlp.service_name_prefix = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.enforce_new_defaults = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.policy_default_rule = default {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.policy_file = policy.yaml {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.group = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.helper_command = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] privsep_osbrick.user = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.group = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.helper_command = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] cinder_sys_admin.user = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.auth_section = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.auth_type = password {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.cafile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.collect_timing = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.send_service_user_token = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.split_loggers = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.tls_ciphers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] service_user.tls_min_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.auth_section = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.auth_type = password {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.collect_timing = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.region_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.split_loggers = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.tls_ciphers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] glance.tls_min_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.backend_availability_zone = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.chap_password = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.chap_username = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.disk_geometry = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.driver_client_cert = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.driver_client_cert_key = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.driver_data_namespace = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.driver_use_ssl = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.extra_capabilities = {} {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.filter_function = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.goodness_function = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.iscsi_target_flags = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.iscsi_write_cache = on {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.iser_helper = tgtadm {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.iser_ip_address = 192.168.122.73 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.iser_port = 3260 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.lvm_share_target = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.lvm_type = auto {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.num_shell_tries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:38 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.replication_device = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.report_discard_supported = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.reserved_percentage = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.target_helper = tgtadm {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.target_ip_address = 192.168.122.73 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.target_port = 3260 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.target_protocol = iscsi {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.trace_flags = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.unique_fqdn_network = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.use_chap_auth = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_backend_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_clear = zero {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_clear_ionice = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_clear_size = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_reports.file_event_handler = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_reports.log_dir = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.backend_host = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.chap_password = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.chap_username = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.disk_geometry = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.driver_client_cert = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.extra_capabilities = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.filter_function = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.goodness_function = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.iser_helper = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.iser_ip_address = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.iser_port = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.lvm_share_target = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.lvm_type = auto {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.num_shell_tries = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.replication_device = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.report_discard_supported = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.reserved_percentage = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.scst_target_driver = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.storage_protocol = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.target_helper = lioadm {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.target_ip_address = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.target_port = 3260 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.trace_flags = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.use_chap_auth = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_clear = zero {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_clear_size = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] lvmdriver-1.volumes_dir = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_notifications.driver = [] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_notifications.retry = -1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] key_manager.fixed_key = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.barbican_api_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.barbican_endpoint = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.barbican_endpoint_type = public {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.barbican_region_name = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.cafile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.collect_timing = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.number_of_retries = 60 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.retry_delay = 1 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.send_service_user_token = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.split_loggers = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.tls_ciphers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.tls_min_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.verify_ssl = True {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican.verify_ssl_path = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.auth_section = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.auth_type = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.cafile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.certfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.collect_timing = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.insecure = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.keyfile = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.split_loggers = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.timeout = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.tls_ciphers = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] barbican_service_user.tls_min_version = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.approle_role_id = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.approle_secret_id = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.auth_method = approle {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.auth_path = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.kv_mountpoint = secret {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.kv_path = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.kv_version = 2 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.namespace = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.root_token_id = **** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.ssl_ca_crt_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.timeout = 60.0 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.token_file = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.token_role = None {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.use_ssl = False {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:32:39 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] ******************************************************************************** {{(pid=76349) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 14:32:39 devstack sudo[76500]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:39 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:39 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:39 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.305s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:32:39 devstack cinder-volume[76495]: INFO cinder.brick.local_dev.lvm [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:39 devstack sudo[76579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:32:39 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:39 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG cinder.brick.local_dev.lvm [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76495) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 09 14:32:39 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:39 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:39 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:40 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:40 devstack sudo[76904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:40 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:40 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:40 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:40 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 09 14:32:40 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:41 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.282s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:41 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:32:41 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:41 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:41 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:32:41 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:41 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:41 devstack sudo[77160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:41 devstack sudo[77160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:41 devstack sudo[77160]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:41 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:41 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:41 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:42 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:42 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:42 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:42 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:42 devstack cinder-volume[76495]: INFO cinder.volume.drivers.lvm [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:42 devstack sudo[77333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:42 devstack sudo[77333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:42 devstack sudo[77333]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:32:42 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:42 devstack sudo[77336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:32:42 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:43 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:43 devstack sudo[77345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:43 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:43 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:43 devstack sudo[77349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:43 devstack sudo[77349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:43 devstack sudo[77349]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:43 devstack sudo[77352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:43 devstack sudo[77352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:43 devstack sudo[77352]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:43 devstack cinder-volume[76495]: INFO cinder.volume.driver [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Driver hasn't implemented _init_vendor_properties() Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG cinder.volume.driver [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76495) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG oslo_db.sqlalchemy.engines [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76495) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:32:43 devstack cinder-volume[76495]: DEBUG dbcounter [-] [76495] Writer thread running {{(pid=76495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG cinder.db.api [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Building query based on filter {{(pid=76495) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG cinder.image.image_utils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76495) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 14:32:44 devstack cinder-volume[76495]: INFO cinder.keymgr.migration [None req-4c993a5d-3f77-42f0-aafa-22886edeb664 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:44 devstack sudo[77356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:32:44 devstack sudo[77356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:44 devstack sudo[77356]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:44 devstack sudo[77359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:44 devstack sudo[77359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:44 devstack sudo[77359]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:44 devstack sudo[77363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:44 devstack sudo[77363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:44 devstack sudo[77363]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:44 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:44 devstack sudo[77368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:44 devstack sudo[77368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:45 devstack sudo[77368]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG cinder.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Notifying Schedulers of capabilities ... {{(pid=76495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:32:45 devstack cinder-volume[76495]: INFO cinder.volume.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Driver initialization completed successfully. Sep 09 14:32:45 devstack cinder-volume[76495]: INFO cinder.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Initiating service 2 cleanup Sep 09 14:32:45 devstack cinder-volume[76495]: INFO cinder.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Service 2 cleanup completed. Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG cinder.service [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Creating RPC server for service cinder-volume {{(pid=76495) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG cinder.service [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76495) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 14:32:45 devstack cinder-volume[76495]: INFO cinder.volume.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:45 devstack sudo[77371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:32:45 devstack sudo[77371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:45 devstack sudo[77371]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:45 devstack sudo[77374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:45 devstack sudo[77374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:45 devstack sudo[77374]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:45 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:45 devstack sudo[77377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:32:45 devstack sudo[77377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:46 devstack sudo[77377]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:46 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:46 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:32:46 devstack sudo[77385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:32:46 devstack sudo[77385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:32:46 devstack sudo[77385]: pam_unix(sudo:session): session closed for user root Sep 09 14:32:46 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:32:46 devstack cinder-volume[76495]: INFO cinder.volume.manager [None req-59df2613-3616-4464-9b9d-143ffa2baeaa None None] Driver post RPC initialization completed successfully. Sep 09 14:32:48 devstack cinder-volume[76349]: DEBUG dbcounter [-] [76349] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76349) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:32:52 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager._thread_info {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:32:52 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread count: 6 {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:32:52 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread info: [<_MainThread(MainThread, started 137906373918848)>, , , , , ] {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:32:56 devstack cinder-volume[76495]: DEBUG dbcounter [-] [76495] Writing DB stats cinder:SELECT=3 {{(pid=76495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:32:56 devstack cinder-volume[76495]: DEBUG dbcounter [-] [76495] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:33:52 devstack sudo[79438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:33:52 devstack sudo[79438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:33:52 devstack sudo[79438]: pam_unix(sudo:session): session closed for user root Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:33:52 devstack sudo[79441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:33:52 devstack sudo[79441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:33:52 devstack sudo[79441]: pam_unix(sudo:session): session closed for user root Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:33:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:33:52 devstack sudo[79444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:33:52 devstack sudo[79444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:33:53 devstack sudo[79444]: pam_unix(sudo:session): session closed for user root Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:33:53 devstack sudo[79465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:33:53 devstack sudo[79465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:33:53 devstack sudo[79465]: pam_unix(sudo:session): session closed for user root Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG cinder.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Notifying Schedulers of capabilities ... {{(pid=76495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager._thread_info {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread count: 6 {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:33:53 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread info: [<_MainThread(MainThread, started 137906373918848)>, , , , , ] {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:34:52 devstack sudo[82805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:34:52 devstack sudo[82805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:34:52 devstack sudo[82805]: pam_unix(sudo:session): session closed for user root Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:34:52 devstack sudo[82812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:34:52 devstack sudo[82812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:34:52 devstack sudo[82812]: pam_unix(sudo:session): session closed for user root Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:34:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:34:52 devstack sudo[82823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:34:52 devstack sudo[82823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:34:53 devstack sudo[82823]: pam_unix(sudo:session): session closed for user root Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:34:53 devstack sudo[82826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:34:53 devstack sudo[82826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:34:53 devstack sudo[82826]: pam_unix(sudo:session): session closed for user root Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG cinder.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Notifying Schedulers of capabilities ... {{(pid=76495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager._thread_info {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread count: 6 {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:34:53 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread info: [<_MainThread(MainThread, started 137906373918848)>, , , , , ] {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:34:56 devstack cinder-volume[76495]: DEBUG dbcounter [-] [76495] Writing DB stats cinder:SELECT=1 {{(pid=76495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:34:56 devstack cinder-volume[76495]: DEBUG dbcounter [-] [76495] Writing DB stats cinder:UPDATE=1 {{(pid=76495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:35:52 devstack sudo[84853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:35:52 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:35:52 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:35:52 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:35:52 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:35:52 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:35:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:35:52 devstack sudo[84925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:35:52 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:35:53 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:35:53 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:35:53 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:35:53 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG cinder.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Notifying Schedulers of capabilities ... {{(pid=76495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager._thread_info {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread count: 6 {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:35:53 devstack cinder-volume[76495]: DEBUG cinder.volume.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] thread info: [<_MainThread(MainThread, started 137906373918848)>, , , , , ] {{(pid=76495) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG oslo_service.periodic_task [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76495) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG cinder.volume.drivers.lvm [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Updating volume stats {{(pid=76495) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:36:52 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 14:36:52 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:36:52 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:36:52 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:36:52 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:36:52 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:36:52 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:36:52 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 14:36:52 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:36:53 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Sep 09 14:36:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:36:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:36:53 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 14:36:53 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:36:53 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Sep 09 14:36:53 devstack cinder-volume[76495]: DEBUG oslo_concurrency.processutils [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76495) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:36:53 devstack cinder-volume[76495]: DEBUG cinder.manager [None req-542eead8-ffa2-4a94-bedd-c4b25605700b None None] Notifying Schedulers of capabilities ... {{(pid=76495) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:36:56 devstack cinder-volume[76495]: DEBUG dbcounter [-] [76495] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76495) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:37:03 devstack cinder-volume[76349]: INFO oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Caught SIGTERM, stopping children Sep 09 14:37:03 devstack cinder-volume[76349]: DEBUG oslo_concurrency.lockutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Acquiring lock "singleton_lock" {{(pid=76349) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:37:03 devstack cinder-volume[76349]: DEBUG oslo_concurrency.lockutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Acquired lock "singleton_lock" {{(pid=76349) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:37:03 devstack cinder-volume[76349]: DEBUG oslo_concurrency.lockutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Releasing lock "singleton_lock" {{(pid=76349) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:37:03 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Stop services. {{(pid=76349) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 14:37:03 devstack cinder-volume[76349]: DEBUG oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Killing children. {{(pid=76349) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 14:37:03 devstack cinder-volume[76349]: INFO oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Waiting on 1 children to exit Sep 09 14:37:05 devstack cinder-volume[76495]: DEBUG oslo_concurrency.lockutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Acquiring lock "singleton_lock" {{(pid=76495) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:37:05 devstack cinder-volume[76495]: DEBUG oslo_concurrency.lockutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Acquired lock "singleton_lock" {{(pid=76495) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:37:05 devstack cinder-volume[76495]: DEBUG oslo_concurrency.lockutils [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Releasing lock "singleton_lock" {{(pid=76495) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:37:05 devstack cinder-volume[76495]: WARNING amqp [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 14:37:05 devstack cinder-volume[76495]: WARNING amqp [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 14:37:05 devstack cinder-volume[76349]: INFO oslo_service.backend._eventlet.service [None req-8fe4c0c8-c257-4062-bb58-3de798520639 None None] Child 76495 exited with status 0 Sep 09 14:37:05 devstack cinder-volume[86521]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 14:37:05 devstack cinder-volume[86521]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 14:37:05 devstack cinder-volume[86521]: we strongly recommend against using it for new projects. Sep 09 14:37:05 devstack cinder-volume[86521]: If you are already using Eventlet, we recommend migrating to a different Sep 09 14:37:05 devstack cinder-volume[86521]: framework. For more detail see Sep 09 14:37:05 devstack cinder-volume[86521]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 14:37:05 devstack cinder-volume[86521]: import eventlet # noqa Sep 09 14:37:07 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:37:07 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:37:07 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:37:08 devstack cinder-volume[86521]: INFO dbcounter [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Registered counter for database cinder Sep 09 14:37:08 devstack cinder-volume[86521]: DEBUG oslo_db.sqlalchemy.engines [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:08 devstack cinder-volume[86521]: DEBUG dbcounter [-] [86521] Writer thread running {{(pid=86521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 14:37:08 devstack cinder-volume[86521]: INFO cinder.rpc [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 14:37:08 devstack cinder-volume[86521]: INFO cinder.rpc [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 14:37:08 devstack cinder-volume[86521]: DEBUG oslo_db.sqlalchemy.engines [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:08 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Determined volume DB was empty at startup. Sep 09 14:37:08 devstack cinder-volume[86521]: DEBUG cinder.volume.manager [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86521) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 14:37:08 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 14:37:08 devstack cinder-volume[86521]: WARNING stevedore.named [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 14:37:08 devstack cinder-volume[86521]: WARNING castellan.key_manager [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:37:08 devstack cinder-volume[86521]: WARNING cinder.keymgr.conf_key_mgr [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:37:08 devstack cinder-volume[86521]: INFO cinder.volume.manager [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 14:37:08 devstack cinder-volume[86521]: DEBUG oslo_db.sqlalchemy.engines [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:09 devstack cinder-volume[86521]: INFO oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Starting 1 workers Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Started child 86736 {{(pid=86521) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Full set of CONF: {{(pid=86521) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] ******************************************************************************** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Configuration options gathered from: {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] ================================================================================ {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] allow_availability_zone_fallback = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] allow_compression_on_image_upload = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] allowed_direct_url_schemes = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] api_rate_limit = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] auth_strategy = keystone {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_availability_zone = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_host = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_stats_polling_interval = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backup_api_class = cinder.backup.api.API {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backup_name_template = backup-%s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backup_use_same_host = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backup_use_temp_snapshot = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] chap_password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] chap_username = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86736]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_internal_tenant_project_id = e1a1690bfc0e4cb09463a4c4400d9c24 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_internal_tenant_user_id = c714851e14f644a8897feb2507567a3f {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cluster = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] compression_format = gzip {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] compute_api_class = cinder.compute.nova.API {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] config_dir = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] config_source = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] control_exchange = openstack {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] debug = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] default_availability_zone = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] default_group_type = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] default_volume_type = QuobyteHD {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] disk_geometry = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] driver_client_cert = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] driver_client_cert_key = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] driver_data_namespace = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] driver_ssl_cert_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] driver_ssl_cert_verify = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] driver_use_ssl = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] enable_new_services = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] enable_unsupported_driver = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] enabled_backends = ['QuobyteHD'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] enforce_multipath_for_image_xfer = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] filter_function = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_api_insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_api_servers = ['http://192.168.122.73/image'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_api_ssl_compression = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_ca_certificates_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_catalog_info = image:glance:publicURL {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_num_retries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance_request_timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] goodness_function = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] graceful_shutdown_timeout = 5 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] group_api_class = cinder.group.api.API {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] host = devstack {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_compress_on_upload = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_conversion_address_space_limit = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_conversion_cpu_limit = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_conversion_disable = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_upload_use_cinder_backend = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_upload_use_internal_tenant = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_volume_cache_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_volume_cache_max_count = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] image_volume_cache_max_size_gb = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] init_host_max_objects_retrieval = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] instance_format = [instance: %(uuid)s] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] iscsi_target_flags = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] iscsi_write_cache = on {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] iser_helper = tgtadm {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] iser_ip_address = 192.168.122.73 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] iser_port = 3260 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_color = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_config_append = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_dir = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_options = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_rotate_interval = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_rotate_interval_type = days {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] log_rotation_type = none {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] max_age = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] max_logfile_count = 30 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] max_logfile_size_mb = 200 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] max_over_subscription_ratio = 20.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] message_reap_interval = 86400 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] message_ttl = 2592000 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] migration_create_volume_timeout_secs = 300 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.remotefs [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86736) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] monkey_patch = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] monkey_patch_modules = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] my_ip = 192.168.122.73 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] no_snapshot_gb_quota = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] num_iser_scan_tries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] num_shell_tries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] num_volume_device_scan_tries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] nvmeof_conn_info_version = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] nvmet_ns_id = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] nvmet_port_id = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_max_limit = 1000 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_volume_ext_list = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_volume_listen_port = 8776 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_volume_use_ssl = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] osapi_volume_workers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] per_volume_size_limit = -1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] periodic_fuzzy_delay = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] periodic_interval = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] public_endpoint = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] publish_errors = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_backup_gigabytes = 1000 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_backups = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_gigabytes = 1000 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_groups = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_snapshots = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] quota_volumes = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] rate_limit_burst = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] rate_limit_except_level = CRITICAL {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] rate_limit_interval = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] reinit_driver_count = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] replication_device = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] report_discard_supported = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] report_interval = 120 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] reservation_clean_interval = 86400 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] reservation_expire = 86400 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] reserved_image_namespaces = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] reserved_percentage = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] rpc_response_timeout = 120 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] run_external_periodic_tasks = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] scst_target_driver = iscsi {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] scst_target_iqn_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_down_time = 720 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] shell_completion = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] snapshot_name_template = snapshot-%s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] split_loggers = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] state_path = /opt/stack/data/cinder {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] storage_availability_zone = nova {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] storage_protocol = iSCSI {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] syslog_log_facility = LOG_USER {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] target_helper = lioadm {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] target_ip_address = 192.168.122.73 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] target_port = 3260 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] target_protocol = iscsi {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] target_secondary_ip_addresses = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] trace_flags = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] transport_url = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] until_refresh = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_chap_auth = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_default_quota_class = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_journal = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_json = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_multipath_for_image_xfer = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_stderr = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] use_syslog = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] verify_glance_signatures = enabled {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_api_class = cinder.volume.api.API {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_backend_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_clear = zero {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_clear_ionice = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_clear_size = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_copy_bps_limit = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_dd_blocksize = 1M {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_name_template = volume-%s {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_service_inithost_offload = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volume_usage_audit_period = month {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] zoning_mode = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_concurrency.disable_process_locking = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.auth_section = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.auth_type = password {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.auth_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.cache = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.include_service_catalog = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.interface = public {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcache_username = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.region_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.service_type = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.73/identity {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.backend = dogpile.cache.null {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.backend_argument = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.backend_expiration_time = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.config_prefix = cache.oslo {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.debug_cache_backend = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.enable_retry_client = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.enable_socket_keepalive = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.expiration_time = 600 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.hashclient_retry_attempts = 2 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_dead_retry = 300 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_pool_maxsize = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_sasl_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.proxies = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.redis_db = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.redis_server = localhost:6379 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.retry_attempts = 2 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.retry_delay = 0.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.socket_keepalive_count = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.socket_keepalive_idle = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.socket_keepalive_interval = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.socket_timeout = 1.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.tls_allowed_ciphers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.tls_cafile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.tls_certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.tls_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.tls_keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cache.username = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] coordination.backend_url = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.asyncio_connection = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.asyncio_slave_connection = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.backend = sqlalchemy {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.connection = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.connection_debug = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.connection_parameters = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.connection_recycle_time = 3600 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.connection_trace = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86736) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 14:37:09 devstack cinder-volume[86736]: WARNING cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 14:37:09 devstack cinder-volume[86736]: WARNING cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Running cmd (subprocess): mount.quobyte {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.db_inc_retry_interval = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.db_max_retries = 20 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.db_max_retry_interval = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.db_retry_interval = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.max_overflow = 50 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.max_pool_size = 5 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.max_retries = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.mysql_wsrep_sync_wait = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.pool_timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.retry_interval = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.slave_connection = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.sqlite_synchronous = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.synchronous_reader = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] database.use_db_reconnect = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_tracing.insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.connection_string = messaging:// {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.es_doc_type = notification {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.es_scroll_size = 10000 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.es_scroll_time = 2m {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.filter_error_trace = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.hmac_keys = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.sentinel_service_name = mymaster {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.socket_timeout = 0.1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.trace_requests = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler.trace_sqlalchemy = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler_jaeger.process_tags = {} {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler_jaeger.service_name_prefix = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] profiler_otlp.service_name_prefix = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.enforce_new_defaults = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.policy_default_rule = default {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.policy_file = policy.yaml {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.group = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.helper_command = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] privsep_osbrick.user = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.group = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.helper_command = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] cinder_sys_admin.user = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.auth_section = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.auth_type = password {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.cafile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.collect_timing = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.send_service_user_token = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.split_loggers = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.tls_ciphers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] service_user.tls_min_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.auth_section = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.auth_type = password {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.collect_timing = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.region_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.split_loggers = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.tls_ciphers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] glance.tls_min_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.backend_availability_zone = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.chap_password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.chap_username = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.disk_geometry = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.driver_client_cert = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.driver_client_cert_key = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.driver_data_namespace = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.driver_use_ssl = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.extra_capabilities = {} {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.filter_function = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.goodness_function = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.iscsi_target_flags = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.iscsi_write_cache = on {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.iser_helper = tgtadm {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.iser_ip_address = 192.168.122.73 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.iser_port = 3260 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_host = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_login = admin {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_mount_options = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_private_key = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_share_path = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.num_shell_tries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.quobyte_volume_url = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.replication_device = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.report_discard_supported = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.reserved_percentage = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.target_helper = tgtadm {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.target_ip_address = 192.168.122.73 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.target_port = 3260 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.target_protocol = iscsi {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.trace_flags = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.unique_fqdn_network = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.use_chap_auth = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_backend_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_clear = zero {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_clear_ionice = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_clear_size = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_reports.file_event_handler = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_reports.log_dir = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.backend_availability_zone = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.backend_host = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.chap_password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.chap_username = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.chiscsi_conf = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.disk_geometry = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.driver_client_cert = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.driver_data_namespace = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.driver_use_ssl = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.extra_capabilities = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.filter_function = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.goodness_function = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.iser_helper = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.iser_ip_address = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.iser_port = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.iser_target_prefix = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_host = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_login = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_mount_options = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_password = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_private_key = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_share_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_ssh_port = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.num_shell_tries = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.nvmet_port_id = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.replication_device = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.report_discard_supported = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.reserved_percentage = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.scst_target_driver = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.storage_protocol = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.target_helper = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack quobyte-client[86737]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.target_ip_address = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.target_port = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.target_prefix = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.target_protocol = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.trace_flags = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack quobyte-client[86737]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.use_chap_auth = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_clear = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_clear_size = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] QuobyteHD.volumes_dir = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86736]: INFO cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 ... Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e -c /etc/quobyte/client-cinder.cfg {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_notifications.driver = [] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_notifications.retry = -1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] key_manager.fixed_key = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.barbican_api_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.barbican_endpoint = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.barbican_endpoint_type = public {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.barbican_region_name = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.cafile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.collect_timing = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.number_of_retries = 60 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.retry_delay = 1 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.send_service_user_token = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.split_loggers = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.tls_ciphers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.tls_min_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.verify_ssl = True {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican.verify_ssl_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.auth_section = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.auth_type = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.cafile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.certfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.collect_timing = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.insecure = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.keyfile = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.split_loggers = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.timeout = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.tls_ciphers = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] barbican_service_user.tls_min_version = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.approle_role_id = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e -c /etc/quobyte/client-cinder.cfg Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.approle_secret_id = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.auth_method = approle {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.auth_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.kv_mountpoint = secret {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.kv_path = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.kv_version = 2 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.namespace = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.root_token_id = **** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.ssl_ca_crt_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.timeout = 60.0 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.token_file = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.token_role = None {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.use_ssl = False {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:09 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] ******************************************************************************** {{(pid=86521) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 14:37:09 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.416s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:09 devstack cinder-volume[86736]: INFO cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 succeeded Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.437s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:09 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:09 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:09 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:10 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.247s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.volume.driver [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Driver hasn't implemented _init_vendor_properties() Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.volume.driver [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3789901733398, 'free_capacity_gb': 1773.3789901733398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86736) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG dbcounter [-] [86736] Writer thread running {{(pid=86736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.db.api [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Building query based on filter {{(pid=86736) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.image.image_utils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86736) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.keymgr.migration [None req-ba7b2e95-7270-4543-8b04-b34d90f31891 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:10 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:10 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:10 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.265s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Notifying Schedulers of capabilities ... {{(pid=86736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Driver initialization completed successfully. Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Initiating service 3 cleanup Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Service 3 cleanup completed. Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.service [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Creating RPC server for service cinder-volume {{(pid=86736) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.service [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86736) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:10 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:10 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:10 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:10 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.252s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:10 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-a830e8f3-fe9a-434a-9732-49f33d10fc3c None None] Driver post RPC initialization completed successfully. Sep 09 14:37:15 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:15 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:15 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=86736) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:15 devstack cinder-volume[86736]: DEBUG cinder.volume.drivers.quobyte [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=86736) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:15 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86736) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:15 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:15 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:15 devstack cinder-volume[86521]: INFO oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Caught SIGTERM, stopping children Sep 09 14:37:15 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:15 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Acquiring lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:37:15 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Acquired lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:37:15 devstack cinder-volume[86521]: DEBUG oslo_concurrency.lockutils [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Releasing lock "singleton_lock" {{(pid=86521) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:37:15 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Stop services. {{(pid=86521) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 14:37:15 devstack cinder-volume[86521]: DEBUG oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Killing children. {{(pid=86521) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 14:37:15 devstack cinder-volume[86521]: INFO oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Waiting on 1 children to exit Sep 09 14:37:16 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:16 devstack cinder-volume[86736]: DEBUG oslo_concurrency.processutils [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.494s {{(pid=86736) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:16 devstack cinder-volume[86736]: DEBUG cinder.manager [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Notifying Schedulers of capabilities ... {{(pid=86736) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Unable to connect to AMQP server on 192.168.122.73:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server [None req-fbe3d6f6-3a17-4de6-b5d0-238cc789897f None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.73:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server method() Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return _publish( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server listener(*args) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.73:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 14:37:16 devstack cinder-volume[86736]: ERROR oslo_messaging.rpc.server Sep 09 14:37:18 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Acquiring lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:37:18 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Acquired lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:37:18 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Releasing lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:37:18 devstack cinder-volume[86736]: WARNING amqp [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 14:37:18 devstack cinder-volume[86736]: WARNING amqp [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 14:37:18 devstack cinder-volume[86521]: INFO oslo_service.backend._eventlet.service [None req-bae97a52-e40f-4fa0-bcc6-488c2a087162 None None] Child 86736 exited with status 0 Sep 09 14:37:19 devstack cinder-volume[87029]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 14:37:19 devstack cinder-volume[87029]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 14:37:19 devstack cinder-volume[87029]: we strongly recommend against using it for new projects. Sep 09 14:37:19 devstack cinder-volume[87029]: If you are already using Eventlet, we recommend migrating to a different Sep 09 14:37:19 devstack cinder-volume[87029]: framework. For more detail see Sep 09 14:37:19 devstack cinder-volume[87029]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 14:37:19 devstack cinder-volume[87029]: import eventlet # noqa Sep 09 14:37:22 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87029) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 14:37:22 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87029) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 14:37:22 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87029) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 14:37:23 devstack cinder-volume[87029]: INFO dbcounter [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Registered counter for database cinder Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_db.sqlalchemy.engines [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG dbcounter [-] [87029] Writer thread running {{(pid=87029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 14:37:23 devstack cinder-volume[87029]: INFO cinder.rpc [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 14:37:23 devstack cinder-volume[87029]: INFO cinder.rpc [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_db.sqlalchemy.engines [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:23 devstack cinder-volume[87029]: INFO cinder.volume.manager [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Determined volume DB was empty at startup. Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG cinder.volume.manager [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87029) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 14:37:23 devstack cinder-volume[87029]: WARNING stevedore.named [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 14:37:23 devstack cinder-volume[87029]: WARNING castellan.key_manager [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:37:23 devstack cinder-volume[87029]: WARNING cinder.keymgr.conf_key_mgr [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 14:37:23 devstack cinder-volume[87029]: INFO cinder.volume.manager [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_db.sqlalchemy.engines [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:23 devstack cinder-volume[87029]: INFO oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Starting 1 workers Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Started child 87325 {{(pid=87029) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Full set of CONF: {{(pid=87029) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] ******************************************************************************** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] Configuration options gathered from: {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] ================================================================================ {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] allow_availability_zone_fallback = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] allow_compression_on_image_upload = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] allowed_direct_url_schemes = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] api_rate_limit = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] auth_strategy = keystone {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_availability_zone = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_host = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_stats_polling_interval = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backup_api_class = cinder.backup.api.API {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backup_name_template = backup-%s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backup_use_same_host = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backup_use_temp_snapshot = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] chap_password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] chap_username = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_internal_tenant_project_id = e1a1690bfc0e4cb09463a4c4400d9c24 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_internal_tenant_user_id = c714851e14f644a8897feb2507567a3f {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cluster = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] compression_format = gzip {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] compute_api_class = cinder.compute.nova.API {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] config_dir = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] config_source = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] control_exchange = openstack {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] debug = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] default_availability_zone = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] default_group_type = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87325]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] default_volume_type = QuobyteHD {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] disk_geometry = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] driver_client_cert = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] driver_client_cert_key = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] driver_data_namespace = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] driver_ssl_cert_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] driver_ssl_cert_verify = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] driver_use_ssl = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] enable_new_services = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] enable_unsupported_driver = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] enabled_backends = ['QuobyteHD'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] enforce_multipath_for_image_xfer = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] filter_function = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_api_insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_api_servers = ['http://192.168.122.73/image'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_api_ssl_compression = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_ca_certificates_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_catalog_info = image:glance:publicURL {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_num_retries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance_request_timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] goodness_function = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] graceful_shutdown_timeout = 5 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] group_api_class = cinder.group.api.API {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] host = devstack {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_compress_on_upload = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_conversion_address_space_limit = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_conversion_cpu_limit = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_conversion_disable = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_upload_use_cinder_backend = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_upload_use_internal_tenant = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_volume_cache_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_volume_cache_max_count = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] image_volume_cache_max_size_gb = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] init_host_max_objects_retrieval = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] instance_format = [instance: %(uuid)s] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] iscsi_target_flags = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] iscsi_write_cache = on {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] iser_helper = tgtadm {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] iser_ip_address = 192.168.122.73 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] iser_port = 3260 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_color = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_config_append = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_dir = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_options = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_rotate_interval = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_rotate_interval_type = days {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] log_rotation_type = none {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] max_age = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] max_logfile_count = 30 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] max_logfile_size_mb = 200 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] max_over_subscription_ratio = 20.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] message_reap_interval = 86400 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] message_ttl = 2592000 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] migration_create_volume_timeout_secs = 300 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] monkey_patch = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] monkey_patch_modules = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] my_ip = 192.168.122.73 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] no_snapshot_gb_quota = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] num_iser_scan_tries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] num_shell_tries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] num_volume_device_scan_tries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] nvmeof_conn_info_version = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] nvmet_ns_id = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] nvmet_port_id = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_max_limit = 1000 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_volume_ext_list = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_volume_listen = 0.0.0.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_volume_listen_port = 8776 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_volume_use_ssl = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] osapi_volume_workers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] per_volume_size_limit = -1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] periodic_fuzzy_delay = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] periodic_interval = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] project_id_regex = [0-9a-f\-]+ {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] public_endpoint = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] publish_errors = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_backup_gigabytes = 1000 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_backups = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_gigabytes = 1000 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_groups = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_snapshots = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] quota_volumes = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] rate_limit_burst = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] rate_limit_except_level = CRITICAL {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] rate_limit_interval = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] reinit_driver_count = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] replication_device = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] report_discard_supported = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] report_interval = 120 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] reservation_clean_interval = 86400 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] reservation_expire = 86400 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] reserved_image_namespaces = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] reserved_percentage = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] rpc_response_timeout = 120 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] run_external_periodic_tasks = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] scst_target_driver = iscsi {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] scst_target_iqn_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_down_time = 720 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] shell_completion = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] snapshot_name_template = snapshot-%s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 14:37:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87325) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] split_loggers = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] state_path = /opt/stack/data/cinder {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] storage_availability_zone = nova {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] storage_protocol = iSCSI {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] syslog_log_facility = LOG_USER {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] target_helper = lioadm {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] target_ip_address = 192.168.122.73 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] target_port = 3260 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] target_protocol = iscsi {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] target_secondary_ip_addresses = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] trace_flags = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] transfer_api_class = cinder.transfer.api.API {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] transport_url = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] until_refresh = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_chap_auth = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_default_quota_class = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_journal = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_json = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_multipath_for_image_xfer = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_stderr = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] use_syslog = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] verify_glance_signatures = enabled {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_api_class = cinder.volume.api.API {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_backend_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_clear = zero {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_clear_ionice = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_clear_size = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_copy_bps_limit = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_dd_blocksize = 1M {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_name_template = volume-%s {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_service_inithost_offload = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volume_usage_audit_period = month {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] zoning_mode = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_concurrency.disable_process_locking = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:23 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.auth_section = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.auth_type = password {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.auth_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.cache = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.delay_auth_decision = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.http_connect_timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.include_service_catalog = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.interface = public {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcache_username = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.region_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.service_token_roles_required = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.service_type = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.token_cache_time = 300 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.73/identity {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.backend = dogpile.cache.null {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.backend_argument = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.backend_expiration_time = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.config_prefix = cache.oslo {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.debug_cache_backend = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.enable_retry_client = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.enable_socket_keepalive = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.expiration_time = 600 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.hashclient_retry_attempts = 2 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_dead_retry = 300 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_pool_maxsize = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_sasl_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.proxies = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.redis_db = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.redis_sentinel_service_name = mymaster {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.redis_server = localhost:6379 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.retry_attempts = 2 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.retry_delay = 0.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.socket_keepalive_count = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.socket_keepalive_idle = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.socket_keepalive_interval = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.socket_timeout = 1.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.tls_allowed_ciphers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.tls_cafile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.tls_certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.tls_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.tls_keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cache.username = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] coordination.backend_url = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.asyncio_connection = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.asyncio_slave_connection = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.backend = sqlalchemy {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.connection = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.connection_debug = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.connection_parameters = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.connection_recycle_time = 3600 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.connection_trace = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.db_inc_retry_interval = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.db_max_retries = 20 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.db_max_retry_interval = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.db_retry_interval = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.max_overflow = 50 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.max_pool_size = 5 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.max_retries = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.mysql_wsrep_sync_wait = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.pool_timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.retry_interval = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.slave_connection = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.sqlite_synchronous = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.synchronous_reader = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] database.use_db_reconnect = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_tracing.insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.connection_string = messaging:// {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.es_doc_type = notification {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.es_scroll_size = 10000 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.es_scroll_time = 2m {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.filter_error_trace = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.hmac_keys = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.sentinel_service_name = mymaster {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.socket_timeout = 0.1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.trace_requests = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler.trace_sqlalchemy = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler_jaeger.process_tags = {} {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler_jaeger.service_name_prefix = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] profiler_otlp.service_name_prefix = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.enforce_new_defaults = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.policy_default_rule = default {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.policy_file = policy.yaml {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_policy.remote_timeout = 60.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.group = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.helper_command = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] privsep_osbrick.user = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.group = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.helper_command = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] cinder_sys_admin.user = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.auth_section = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.auth_type = password {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.cafile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.collect_timing = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.send_service_user_token = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.split_loggers = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.tls_ciphers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] service_user.tls_min_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.auth_section = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.auth_type = password {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.collect_timing = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.region_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.split_loggers = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.tls_ciphers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] glance.tls_min_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.backend_availability_zone = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.chap_password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.chap_username = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.disk_geometry = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.driver_client_cert = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.driver_client_cert_key = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.driver_data_namespace = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.driver_use_ssl = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.enable_unsupported_driver = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.extra_capabilities = {} {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.filter_function = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.goodness_function = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.iscsi_target_flags = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.iscsi_write_cache = on {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.iser_helper = tgtadm {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.iser_ip_address = 192.168.122.73 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.iser_port = 3260 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_host = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_login = admin {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_mount_options = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_private_key = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_share_path = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_ssh_port = 22 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.num_shell_tries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.nvmet_port_id = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87325) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 14:37:24 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 14:37:24 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Running cmd (subprocess): mount.quobyte {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_client_cfg = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.quobyte_volume_url = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.replication_device = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.report_discard_supported = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.reserved_percentage = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.scst_target_driver = iscsi {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.scst_target_iqn_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.storage_protocol = iSCSI {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.target_helper = tgtadm {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.target_ip_address = 192.168.122.73 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.target_port = 3260 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.target_protocol = iscsi {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.trace_flags = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.unique_fqdn_network = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.use_chap_auth = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_backend_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_clear = zero {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_clear_ionice = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_clear_size = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_reports.file_event_handler = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_reports.log_dir = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.backend_availability_zone = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.backend_host = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.chap_password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.chap_username = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.chiscsi_conf = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.disk_geometry = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.driver_client_cert = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.driver_client_cert_key = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.driver_data_namespace = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.driver_use_ssl = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.extra_capabilities = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.filter_function = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.goodness_function = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.iscsi_target_flags = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.iscsi_write_cache = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.iser_helper = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.iser_ip_address = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.iser_port = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.iser_target_prefix = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_host = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_login = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_mount_options = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_password = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_private_key = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_share_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_ssh_port = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.num_shell_tries = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nvmet_ns_id = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.nvmet_port_id = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.replication_device = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.report_discard_supported = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.reserved_percentage = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.scst_target_driver = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.storage_protocol = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.target_helper = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.target_ip_address = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.target_port = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.target_prefix = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.target_protocol = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.trace_flags = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.unique_fqdn_network = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.use_chap_auth = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_clear = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_clear_ionice = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_clear_size = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] QuobyteHD.volumes_dir = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.ssl_version = {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_notifications.driver = [] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_notifications.retry = -1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] oslo_messaging_notifications.transport_url = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] key_manager.fixed_key = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.barbican_api_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.barbican_endpoint = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.barbican_endpoint_type = public {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.barbican_region_name = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.cafile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.collect_timing = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.number_of_retries = 60 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.retry_delay = 1 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.send_service_user_token = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.split_loggers = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.tls_ciphers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.tls_min_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.verify_ssl = True {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican.verify_ssl_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.auth_section = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.auth_type = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.cafile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.certfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.collect_timing = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.insecure = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.keyfile = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.split_loggers = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.timeout = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.tls_ciphers = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] barbican_service_user.tls_min_version = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.approle_role_id = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.approle_secret_id = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.auth_method = approle {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.auth_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.kv_mountpoint = secret {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.kv_path = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.kv_version = 2 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.namespace = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.root_token_id = **** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.ssl_ca_crt_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.timeout = 60.0 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.token_file = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.token_role = None {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.use_ssl = False {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 14:37:24 devstack cinder-volume[87029]: DEBUG oslo_service.backend._eventlet.service [None req-7d10b3c5-e9c4-43f6-ade1-9df03f74222c None None] ******************************************************************************** {{(pid=87029) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:24 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:24 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:24 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.247s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:24 devstack cinder-volume[87325]: INFO cinder.volume.driver [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Driver hasn't implemented _init_vendor_properties() Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.driver [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3789901733398, 'free_capacity_gb': 1773.3789901733398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87325) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_db.sqlalchemy.engines [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writer thread running {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.db.api [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Building query based on filter {{(pid=87325) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87325) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:24 devstack cinder-volume[87325]: INFO cinder.keymgr.migration [None req-1c0d4728-159a-421c-aa9e-0823f38af7a3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 14:37:24 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:24 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:24 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.226s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:37:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Driver initialization completed successfully. Sep 09 14:37:24 devstack cinder-volume[87325]: INFO cinder.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Initiating service 3 cleanup Sep 09 14:37:24 devstack cinder-volume[87325]: INFO cinder.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Service 3 cleanup completed. Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.service [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Creating RPC server for service cinder-volume {{(pid=87325) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.service [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87325) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 14:37:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:37:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:37:24 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:37:24 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:37:25 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Sep 09 14:37:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.241s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:37:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8fde320e-8cd5-4b5e-a614-4ebe81607e7e None None] Driver post RPC initialization completed successfully. Sep 09 14:37:33 devstack cinder-volume[87029]: DEBUG dbcounter [-] [87029] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:37:34 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:37:35 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:37:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:37:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 6 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:37:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Flow 'volume_create_manager' (68bc004c-c7eb-412b-8772-66095742b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f988325d-8b83-43c1-a2b4-0ce72cc6c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f988325d-8b83-43c1-a2b4-0ce72cc6c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1883006345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841f949b-d1f8-46cf-8960-643074a530e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47082c0d8e0e4b3a8ce0a0df8bb1bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:23Z,use_quota=True,user_id='8ca00a965e41445dad6a7425d2b2437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef13bf2-e3af-4a9a-a56c-c69a21859f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef13bf2-e3af-4a9a-a56c-c69a21859f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe029579-db12-4d94-b9e2-72087c14ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe029579-db12-4d94-b9e2-72087c14ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841f949b-d1f8-46cf-8960-643074a530e0', 'volume_name': 'volume-841f949b-d1f8-46cf-8960-643074a530e0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af584bdb-4128-496d-8681-271a63830053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af584bdb-4128-496d-8681-271a63830053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b965834a-d0d1-49ec-a03a-0df2cc3e521c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Volume 841f949b-d1f8-46cf-8960-643074a530e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841f949b-d1f8-46cf-8960-643074a530e0', 'volume_size': 1} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1883006345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841f949b-d1f8-46cf-8960-643074a530e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47082c0d8e0e4b3a8ce0a0df8bb1bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:23Z,use_quota=True,user_id='8ca00a965e41445dad6a7425d2b2437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Creating volume 841f949b-d1f8-46cf-8960-643074a530e0 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:38:24 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:38:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:24 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 1073741824 Sep 09 14:38:24 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:25 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 1073741824" returned: 0 in 1.379s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:25 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 Sep 09 14:38:25 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:25 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0" returned: 0 in 0.427s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:38:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b965834a-d0d1-49ec-a03a-0df2cc3e521c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841f949b-d1f8-46cf-8960-643074a530e0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d855a867-c0a1-4065-beab-874913b498ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Volume volume-841f949b-d1f8-46cf-8960-643074a530e0 (841f949b-d1f8-46cf-8960-643074a530e0): created successfully Sep 09 14:38:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d855a867-c0a1-4065-beab-874913b498ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Flow 'volume_create_manager' (68bc004c-c7eb-412b-8772-66095742b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-da63672c-6abb-4b8f-b39a-8ded8f2d8ce7 req-9c2003ca-9929-4fd7-97ca-ec45ae01c858 tempest-VolumesGetTestJSON-816782491 None] Created volume successfully. Sep 09 14:38:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Acquiring lock "cinder-841f949b-d1f8-46cf-8960-643074a530e0-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Lock "cinder-841f949b-d1f8-46cf-8960-643074a530e0-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Acquiring lock "cinder-quobyte-841f949b-d1f8-46cf-8960-643074a530e0" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Lock "cinder-quobyte-841f949b-d1f8-46cf-8960-643074a530e0" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:27 devstack cinder-volume[87325]: INFO oslo.privsep.daemon [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprh2s_ql2/privsep.sock'] Sep 09 14:38:27 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprh2s_ql2/privsep.sock Sep 09 14:38:27 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 14:38:29 devstack cinder-volume[87325]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 09 14:38:30 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:30 devstack cinder-volume[87325]: INFO oslo.privsep.daemon [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Spawned new privsep daemon via rootwrap Sep 09 14:38:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Accepted privsep connection to /tmp/tmprh2s_ql2/privsep.sock {{(pid=87325) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 09 14:38:30 devstack cinder-volume[87325]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 09 14:38:30 devstack cinder-volume[87325]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 09 14:38:30 devstack cinder-volume[87325]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 09 14:38:30 devstack cinder-volume[87325]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88265 Sep 09 14:38:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[47220803-3d42-4c99-9af2-8d25e85d3a72]: (2,) {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:38:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21e8be8-2d44-4190-9387-d1d6c81634cf]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:38:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:30 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 Sep 09 14:38:30 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:31 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0" returned: 0 in 1.487s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:31 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0 Sep 09 14:38:31 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:32 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-841f949b-d1f8-46cf-8960-643074a530e0" returned: 0 in 0.510s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Lock "cinder-quobyte-841f949b-d1f8-46cf-8960-643074a530e0" released by "delete_volume" :: held 4.717s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:32 devstack cinder-volume[87325]: WARNING cinder.quota [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:38:32 devstack cinder-volume[87325]: WARNING cinder.quota [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:38:32 devstack cinder-volume[87325]: DEBUG cinder.quota [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Created reservations ['b31ececa-d40f-4244-95e8-686c6ab3f9c3', 'e0d3ac05-d712-4d1b-93ed-dc32851e450a', '0e3ffde6-662a-4509-9c42-3e294dc279a5', 'e419461b-b3e0-48ba-acea-2153f4b1fad8'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:33 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:38:33 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:33 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.367s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG cinder.manager [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:38:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Deleted volume successfully. Sep 09 14:38:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-4bac762f-a0a5-49bd-8c0b-cc0c047e7641 req-5590818c-73fa-42d7-a426-2a113d1838c7 tempest-VolumesGetTestJSON-816782491 None] Lock "cinder-841f949b-d1f8-46cf-8960-643074a530e0-delete_volume" released by "delete_volume" :: held 5.906s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Flow 'volume_create_manager' (1b629701-8953-4615-bbf3-7168dc74e00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6a8959-18f7-4758-8189-98faed33c8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6a8959-18f7-4758-8189-98faed33c8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1331569536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cab0c0-da74-44c8-98d4-5154e85161c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0a91ea4feb429697c10e8952f41bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:37Z,use_quota=True,user_id='b34053c0cce74bf1a8706a78784e0f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7283d1f-e1bd-486a-b77f-9036eafb6b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7283d1f-e1bd-486a-b77f-9036eafb6b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98735a6-a1e7-4a06-b837-8aba721cc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98735a6-a1e7-4a06-b837-8aba721cc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36cab0c0-da74-44c8-98d4-5154e85161c1', 'volume_name': 'volume-36cab0c0-da74-44c8-98d4-5154e85161c1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6e08f4-d647-45ca-848d-a59390e8661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6e08f4-d647-45ca-848d-a59390e8661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a39941c-6d17-4e9f-940f-69b35bd4f5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:37 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Volume 36cab0c0-da74-44c8-98d4-5154e85161c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36cab0c0-da74-44c8-98d4-5154e85161c1', 'volume_size': 1} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1331569536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cab0c0-da74-44c8-98d4-5154e85161c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0a91ea4feb429697c10e8952f41bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:37Z,use_quota=True,user_id='b34053c0cce74bf1a8706a78784e0f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Creating volume 36cab0c0-da74-44c8-98d4-5154e85161c1 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:38:37 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:38:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:37 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 1073741824 Sep 09 14:38:37 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:38 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 1073741824" returned: 0 in 0.798s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:38 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 Sep 09 14:38:38 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:38 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a39941c-6d17-4e9f-940f-69b35bd4f5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36cab0c0-da74-44c8-98d4-5154e85161c1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e493f6f3-7928-4374-aef3-d41a28c4e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Volume volume-36cab0c0-da74-44c8-98d4-5154e85161c1 (36cab0c0-da74-44c8-98d4-5154e85161c1): created successfully Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e493f6f3-7928-4374-aef3-d41a28c4e77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Flow 'volume_create_manager' (1b629701-8953-4615-bbf3-7168dc74e00b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5a7fbb3b-470f-48db-9ae0-01ba511e0351 tempest-VolumesAdminNegativeTest-1892840320 None] Created volume successfully. Sep 09 14:38:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Acquiring lock "cinder-36cab0c0-da74-44c8-98d4-5154e85161c1-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Lock "cinder-36cab0c0-da74-44c8-98d4-5154e85161c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Acquiring lock "cinder-quobyte-36cab0c0-da74-44c8-98d4-5154e85161c1" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Lock "cinder-quobyte-36cab0c0-da74-44c8-98d4-5154e85161c1" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b71d1e-865d-4852-97a1-09a435da975f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:38:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:39 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 Sep 09 14:38:39 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:40 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1" returned: 0 in 0.441s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:40 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1 Sep 09 14:38:40 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:40 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-36cab0c0-da74-44c8-98d4-5154e85161c1" returned: 0 in 0.323s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Lock "cinder-quobyte-36cab0c0-da74-44c8-98d4-5154e85161c1" released by "delete_volume" :: held 0.838s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Created reservations ['dea33361-c8b8-4b05-b918-23c752b92cab', '9601623f-a42e-4250-b6ff-17e6d82ce650', 'a9588fef-52e6-4cd9-8854-27a8e6b2d83e', 'e97e83c6-9795-4fb7-bbca-2966b1f8635f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Flow 'volume_create_manager' (d31fea7e-77c6-4925-a36a-32a0936e9091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc7f9b3-fc9f-43f5-b982-eecb74b90377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc7f9b3-fc9f-43f5-b982-eecb74b90377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-159724452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f5eafd-ecd6-4a2e-bfd0-8ca924354a97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='621118a3fca54d64a3de34a829739c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:40Z,use_quota=True,user_id='b5c70a7c23b141b4a56011765f814456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08530fb-f8aa-4071-8d5d-c5a7391c1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08530fb-f8aa-4071-8d5d-c5a7391c1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04204b1c-0a55-48d0-a74b-595174812c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04204b1c-0a55-48d0-a74b-595174812c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f5eafd-ecd6-4a2e-bfd0-8ca924354a97', 'volume_name': 'volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4fd63f-ebb5-42ad-8c7a-949acf5e457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4fd63f-ebb5-42ad-8c7a-949acf5e457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ac6cd-7111-4e93-ba1a-97faca317a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Volume 46f5eafd-ecd6-4a2e-bfd0-8ca924354a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97', 'volume_size': 1} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-159724452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f5eafd-ecd6-4a2e-bfd0-8ca924354a97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='621118a3fca54d64a3de34a829739c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:40Z,use_quota=True,user_id='b5c70a7c23b141b4a56011765f814456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Creating volume 46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:38:40 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:40 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 1073741824 Sep 09 14:38:40 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:41 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:38:41 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:41 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.293s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:38:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Deleted volume successfully. Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bdffc532-ea8b-4722-ab1e-c15a4ad4b56c tempest-VolumesAdminNegativeTest-1892840320 None] Lock "cinder-36cab0c0-da74-44c8-98d4-5154e85161c1-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:41 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 1073741824" returned: 0 in 0.563s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:41 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 Sep 09 14:38:41 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:41 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ac6cd-7111-4e93-ba1a-97faca317a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb07744-517b-491c-8d63-dac04522330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:41 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Volume volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 (46f5eafd-ecd6-4a2e-bfd0-8ca924354a97): created successfully Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb07744-517b-491c-8d63-dac04522330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Flow 'volume_create_manager' (d31fea7e-77c6-4925-a36a-32a0936e9091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-aaec2b14-8052-4dca-8687-d52ccb66edc3 tempest-VolumesTestJSON-109771747 None] Created volume successfully. Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Flow 'volume_create_manager' (f84d77e5-c66c-42c5-8d39-03047352fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d758c67-9b3d-403f-b4cd-ed1e4cd4d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d758c67-9b3d-403f-b4cd-ed1e4cd4d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-863684956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3f3903-2bc8-4f38-a5c8-3e5670d21869,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='621118a3fca54d64a3de34a829739c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:43Z,use_quota=True,user_id='b5c70a7c23b141b4a56011765f814456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e785303-9259-4d41-9d14-2e6a552c3b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e785303-9259-4d41-9d14-2e6a552c3b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d82e016-9b8c-479b-a3a0-b4cd582fe111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d82e016-9b8c-479b-a3a0-b4cd582fe111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3f3903-2bc8-4f38-a5c8-3e5670d21869', 'volume_name': 'volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7349267d-fb5b-4884-92fa-d9e521d9cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7349267d-fb5b-4884-92fa-d9e521d9cc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec250d-df18-4010-b25b-f33428094df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Volume eb3f3903-2bc8-4f38-a5c8-3e5670d21869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869', 'volume_size': 1} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-863684956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3f3903-2bc8-4f38-a5c8-3e5670d21869,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='621118a3fca54d64a3de34a829739c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:43Z,use_quota=True,user_id='b5c70a7c23b141b4a56011765f814456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Creating volume eb3f3903-2bc8-4f38-a5c8-3e5670d21869 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:38:43 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:38:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:43 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 1073741824 Sep 09 14:38:43 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:44 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 1073741824" returned: 0 in 0.589s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:44 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 Sep 09 14:38:44 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:44 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869" returned: 0 in 0.312s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec250d-df18-4010-b25b-f33428094df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c2c87d-1cbb-4da1-9b3a-55b45d977315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Volume volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 (eb3f3903-2bc8-4f38-a5c8-3e5670d21869): created successfully Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c2c87d-1cbb-4da1-9b3a-55b45d977315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Flow 'volume_create_manager' (f84d77e5-c66c-42c5-8d39-03047352fbba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-26bffbb4-fb88-448b-b0f4-832bd5374ff2 tempest-VolumesTestJSON-109771747 None] Created volume successfully. Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Flow 'volume_create_manager' (bd6c8a81-29f8-47bf-8216-61264a7b8faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e80ae39-6101-4b84-b827-f06e6f315695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e80ae39-6101-4b84-b827-f06e6f315695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1350291439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbc97bc-e4a6-4b4c-a301-d97573f72803,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='621118a3fca54d64a3de34a829739c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:46Z,use_quota=True,user_id='b5c70a7c23b141b4a56011765f814456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1a4bf3-de71-469c-bb06-f5d34cc66afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1a4bf3-de71-469c-bb06-f5d34cc66afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386954f2-378e-40b0-954c-e1aeea750f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386954f2-378e-40b0-954c-e1aeea750f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbc97bc-e4a6-4b4c-a301-d97573f72803', 'volume_name': 'volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a722fe-7540-47c5-a080-113c098b888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a722fe-7540-47c5-a080-113c098b888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3939832f-c8db-4bf6-93aa-0aac4f5ed7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Volume 9dbc97bc-e4a6-4b4c-a301-d97573f72803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803', 'volume_size': 1} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1350291439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbc97bc-e4a6-4b4c-a301-d97573f72803,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='621118a3fca54d64a3de34a829739c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:46Z,use_quota=True,user_id='b5c70a7c23b141b4a56011765f814456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Creating volume 9dbc97bc-e4a6-4b4c-a301-d97573f72803 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:38:46 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:46 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 1073741824 Sep 09 14:38:46 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:46 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 1073741824" returned: 0 in 0.581s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:47 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 Sep 09 14:38:47 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:47 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803" returned: 0 in 0.270s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3939832f-c8db-4bf6-93aa-0aac4f5ed7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b21c679-8448-4d25-a6d5-0836dd80381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Volume volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 (9dbc97bc-e4a6-4b4c-a301-d97573f72803): created successfully Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b21c679-8448-4d25-a6d5-0836dd80381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Flow 'volume_create_manager' (bd6c8a81-29f8-47bf-8216-61264a7b8faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c730573c-88f0-4c6f-b3a9-db326e4d8107 tempest-VolumesTestJSON-109771747 None] Created volume successfully. Sep 09 14:38:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Acquiring lock "cinder-9dbc97bc-e4a6-4b4c-a301-d97573f72803-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Lock "cinder-9dbc97bc-e4a6-4b4c-a301-d97573f72803-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Acquiring lock "cinder-quobyte-9dbc97bc-e4a6-4b4c-a301-d97573f72803" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Lock "cinder-quobyte-9dbc97bc-e4a6-4b4c-a301-d97573f72803" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d29c0-7a86-4bef-8f31-255742720ad0]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:38:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:50 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 Sep 09 14:38:50 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:50 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:50 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803 Sep 09 14:38:50 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:50 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9dbc97bc-e4a6-4b4c-a301-d97573f72803" returned: 0 in 0.279s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Lock "cinder-quobyte-9dbc97bc-e4a6-4b4c-a301-d97573f72803" released by "delete_volume" :: held 0.777s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Created reservations ['e0056a33-aa2f-435d-844c-dcfad504058b', 'd811457b-2aa6-4032-bb6e-50ecd684c24a', '466b6ff8-a824-4e64-9c5a-3ad75c09c4a6', '55d388cb-e27e-4c0c-8749-297689b500ab'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:50 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:38:50 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:51 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.266s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:38:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Deleted volume successfully. Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f2a291e7-f823-40f7-b520-b1157f74f2ed tempest-VolumesTestJSON-109771747 None] Lock "cinder-9dbc97bc-e4a6-4b4c-a301-d97573f72803-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Acquiring lock "cinder-eb3f3903-2bc8-4f38-a5c8-3e5670d21869-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Lock "cinder-eb3f3903-2bc8-4f38-a5c8-3e5670d21869-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Acquiring lock "cinder-quobyte-eb3f3903-2bc8-4f38-a5c8-3e5670d21869" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Lock "cinder-quobyte-eb3f3903-2bc8-4f38-a5c8-3e5670d21869" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e826c074-785a-4b06-871e-10057de55805]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:51 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 Sep 09 14:38:51 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:51 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869" returned: 0 in 0.431s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:51 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869 Sep 09 14:38:51 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:52 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-eb3f3903-2bc8-4f38-a5c8-3e5670d21869" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Lock "cinder-quobyte-eb3f3903-2bc8-4f38-a5c8-3e5670d21869" released by "delete_volume" :: held 0.888s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:52 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:38:52 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Flow 'volume_create_manager' (a07b6811-ef38-422f-bda2-4e40bbb3e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d62e13-ba68-4efd-afec-7724727e35fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d62e13-ba68-4efd-afec-7724727e35fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-894025176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90ceb4f-5db2-4c65-8150-d2e63893a901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3d6b3fd36438dbaf76060ff9623a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:52Z,use_quota=True,user_id='86eeead8361c4b72a8d6660dd93c94eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2c46da-a292-4cfb-af1f-b6db8acc956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2c46da-a292-4cfb-af1f-b6db8acc956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2078da8f-1568-45cf-a9f4-4b08156494d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2078da8f-1568-45cf-a9f4-4b08156494d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90ceb4f-5db2-4c65-8150-d2e63893a901', 'volume_name': 'volume-f90ceb4f-5db2-4c65-8150-d2e63893a901', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341ab483-a140-4060-af8e-06709e99ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341ab483-a140-4060-af8e-06709e99ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384c753e-c26b-4d69-a44d-aaa236e9cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:52 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Volume f90ceb4f-5db2-4c65-8150-d2e63893a901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90ceb4f-5db2-4c65-8150-d2e63893a901', 'volume_size': 1} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-894025176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90ceb4f-5db2-4c65-8150-d2e63893a901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3d6b3fd36438dbaf76060ff9623a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:38:52Z,use_quota=True,user_id='86eeead8361c4b72a8d6660dd93c94eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Creating volume f90ceb4f-5db2-4c65-8150-d2e63893a901 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:38:52 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Created reservations ['94f895f9-a127-42df-90d8-2637318a60a5', 'e70c5fd9-861a-432b-8d10-d9b00bfecedf', '78c1cdb9-71ce-4bfb-bff4-ea108af14fb2', 'fcc4c81c-597d-4fa6-85db-c97c47b7bfda'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:38:52 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 1073741824 Sep 09 14:38:52 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:52 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.401s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 8 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:38:52 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:38:52 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:52 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.334s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:38:52 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Deleted volume successfully. Sep 09 14:38:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0835741f-6719-4c64-bb66-c102bca12442 tempest-VolumesTestJSON-109771747 None] Lock "cinder-eb3f3903-2bc8-4f38-a5c8-3e5670d21869-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:53 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 1073741824" returned: 0 in 0.663s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:53 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 Sep 09 14:38:53 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:53 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901" returned: 0 in 0.279s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384c753e-c26b-4d69-a44d-aaa236e9cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90ceb4f-5db2-4c65-8150-d2e63893a901', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1ed235-8223-4d2c-9a7e-0fa34d83d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:38:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Volume volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 (f90ceb4f-5db2-4c65-8150-d2e63893a901): created successfully Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1ed235-8223-4d2c-9a7e-0fa34d83d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Flow 'volume_create_manager' (a07b6811-ef38-422f-bda2-4e40bbb3e972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:38:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8fcc1a3b-2743-4f06-9829-276f99e31bd3 tempest-AttachVolumeNegativeTest-1886537612 None] Created volume successfully. Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Acquiring lock "cinder-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Lock "cinder-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Acquiring lock "cinder-quobyte-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Lock "cinder-quobyte-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d827bc-40fe-48e5-a51d-5dd79a95d339]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:38:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:53 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 Sep 09 14:38:53 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:54 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97" returned: 0 in 0.392s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:54 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97 Sep 09 14:38:54 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:54 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Lock "cinder-quobyte-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97" released by "delete_volume" :: held 0.791s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Created reservations ['0ea3b039-1316-44a7-ac39-df329798627a', '9304b8c7-bb8f-453b-9371-042562ace907', 'b47b62ee-db75-4269-a162-27e65ae92762', 'e0dc8682-71f0-4bdd-8a4e-9e47411a2e4f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:38:54 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:38:54 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:38:55 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Sep 09 14:38:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.430s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:38:55 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:38:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Deleted volume successfully. Sep 09 14:38:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-99afbe70-18dd-462f-9e7e-a98e1ce17af9 tempest-VolumesTestJSON-109771747 None] Lock "cinder-46f5eafd-ecd6-4a2e-bfd0-8ca924354a97-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:38:58 devstack cinder-volume[87325]: WARNING py.warnings [req-29514ff9-820a-4835-a410-cfd3adb83fc5 req-e8aa13f9-8725-4ca1-9869-825f421e18b3 tempest-AttachVolumeNegativeTest-1886537612 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 09 14:38:58 devstack cinder-volume[87325]: .first() Sep 09 14:38:58 devstack cinder-volume[87325]: Sep 09 14:38:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-29514ff9-820a-4835-a410-cfd3adb83fc5 req-e8aa13f9-8725-4ca1-9869-825f421e18b3 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:38:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-29514ff9-820a-4835-a410-cfd3adb83fc5 req-e8aa13f9-8725-4ca1-9869-825f421e18b3 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:38:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-29514ff9-820a-4835-a410-cfd3adb83fc5 req-e8aa13f9-8725-4ca1-9869-825f421e18b3 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:38:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-29514ff9-820a-4835-a410-cfd3adb83fc5 req-e8aa13f9-8725-4ca1-9869-825f421e18b3 tempest-AttachVolumeNegativeTest-1886537612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-f90ceb4f-5db2-4c65-8150-d2e63893a901', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0494f473-9961-419b-9f21-1483a3d283a9', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:38:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-29514ff9-820a-4835-a410-cfd3adb83fc5 req-e8aa13f9-8725-4ca1-9869-825f421e18b3 tempest-AttachVolumeNegativeTest-1886537612 None] attachment_update completed successfully. Sep 09 14:39:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-82b2d6a8-7ed1-495b-97c5-57bc79672aaa tempest-GroupsV314Test-202680390 None] Group tempest-GroupsV314Test-Group-883370115: creating Sep 09 14:39:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-82b2d6a8-7ed1-495b-97c5-57bc79672aaa tempest-GroupsV314Test-202680390 None] Group tempest-GroupsV314Test-Group-883370115: created successfully Sep 09 14:39:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-82b2d6a8-7ed1-495b-97c5-57bc79672aaa tempest-GroupsV314Test-202680390 None] Create group completed successfully. Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Flow 'volume_create_manager' (37e33130-90eb-4e91-8cdf-684aabeb3a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab91030-5d84-4d14-adb0-f42a7cbfd057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab91030-5d84-4d14-adb0-f42a7cbfd057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852151938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4886d962-8a7b-4e2c-b915-f0f2d7b3197e,host='devstack@QuobyteHD#QuobyteHD',id=5ea2893f-d652-4f08-97f1-7d2cbfa2b368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de60d30505a54b8dbb4425b8a740a6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:39:05Z,use_quota=True,user_id='5227f8b2177e48cb9c9a1caf48ef252d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3caefbc7-bba7-4a29-9bfa-521b7b283e6b),volume_type_id=3caefbc7-bba7-4a29-9bfa-521b7b283e6b)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a99184-7016-44ab-a7d5-d3fa5374b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a99184-7016-44ab-a7d5-d3fa5374b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3459f17a-7d81-4b80-868d-7f4ab29e36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3459f17a-7d81-4b80-868d-7f4ab29e36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea2893f-d652-4f08-97f1-7d2cbfa2b368', 'volume_name': 'volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7a80ca-9c2d-4ca4-821a-f7eae2c6430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7a80ca-9c2d-4ca4-821a-f7eae2c6430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc356bf-6eaf-4dbd-93b8-f99090290e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:05 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Volume 5ea2893f-d652-4f08-97f1-7d2cbfa2b368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368', 'volume_size': 1} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4886d962-8a7b-4e2c-b915-f0f2d7b3197e,created_at=2026-09-09T12:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852151938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4886d962-8a7b-4e2c-b915-f0f2d7b3197e,host='devstack@QuobyteHD#QuobyteHD',id=5ea2893f-d652-4f08-97f1-7d2cbfa2b368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de60d30505a54b8dbb4425b8a740a6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:39:05Z,use_quota=True,user_id='5227f8b2177e48cb9c9a1caf48ef252d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3caefbc7-bba7-4a29-9bfa-521b7b283e6b),volume_type_id=3caefbc7-bba7-4a29-9bfa-521b7b283e6b)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Creating volume 5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:39:05 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:39:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:05 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 1073741824 Sep 09 14:39:05 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:06 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 1073741824" returned: 0 in 0.646s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:06 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 Sep 09 14:39:06 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:06 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" returned: 0 in 0.683s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc356bf-6eaf-4dbd-93b8-f99090290e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d31f13-8251-4561-8f4a-eee21b9e3653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:06 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Volume volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 (5ea2893f-d652-4f08-97f1-7d2cbfa2b368): created successfully Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d31f13-8251-4561-8f4a-eee21b9e3653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Flow 'volume_create_manager' (37e33130-90eb-4e91-8cdf-684aabeb3a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:39:07 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f6901df1-bbaa-4925-bcff-287c96dc6b34 tempest-GroupsV314Test-202680390 None] Created volume successfully. Sep 09 14:39:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:09 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Cloning volume 5ea2893f-d652-4f08-97f1-7d2cbfa2b368 to volume 1e114fa1-83c4-4ae1-9786-51f30462b5e4 Sep 09 14:39:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Creating offline snapshot 80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 of volume 5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:39:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[198160d6-e928-4538-8a27-97e30b9543e8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:09 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 Sep 09 14:39:09 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:10 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" returned: 0 in 0.549s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:10 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 1G Sep 09 14:39:10 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:10 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 1G" returned: 0 in 0.735s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:10 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:39:10 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 Sep 09 14:39:11 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Flow 'volume_create_manager' (931eabf3-5db5-4da1-ae85-f11ba7c15328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be73bcf4-2b94-44ef-b741-38fc0e8d313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be73bcf4-2b94-44ef-b741-38fc0e8d313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1626247172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac384e6-dbae-4121-aa20-9062200daf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95cafb08d69498bbcbfd5a303c815be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:39:11Z,use_quota=True,user_id='49a99c511cf447ef9db165f7beda4a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (accb2a80-a45e-48dd-a80f-bf8fe3c8f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (accb2a80-a45e-48dd-a80f-bf8fe3c8f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb0645-95f8-4e50-a827-a25e94574772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb0645-95f8-4e50-a827-a25e94574772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac384e6-dbae-4121-aa20-9062200daf31', 'volume_name': 'volume-6ac384e6-dbae-4121-aa20-9062200daf31', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6de7f08-4b7d-412b-8cbd-80a31a5d40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6de7f08-4b7d-412b-8cbd-80a31a5d40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96fb7a5-3ed8-4a5a-88da-dfe1df8080d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:11 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Volume 6ac384e6-dbae-4121-aa20-9062200daf31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac384e6-dbae-4121-aa20-9062200daf31', 'volume_size': 1} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:11 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" returned: 0 in 0.505s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:11 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:11 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 Sep 09 14:39:11 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:11 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" returned: 0 in 0.368s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:11 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info Sep 09 14:39:11 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:12 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info" returned: 0 in 0.429s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:12 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:12 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info Sep 09 14:39:12 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:12 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.info" returned: 0 in 0.403s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Acquiring lock "cinder-quobyte-1e114fa1-83c4-4ae1-9786-51f30462b5e4" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-1e114fa1-83c4-4ae1-9786-51f30462b5e4" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] snapshot: 80cb2f80-dd44-4faa-9c5e-6b06b9ac2651, volume: 1e114fa1-83c4-4ae1-9786-51f30462b5e4, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ce76c-9e98-4aa6-b3a0-666f1605b6fc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:13 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 Sep 09 14:39:13 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:13 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" returned: 0 in 1.078s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:39:13 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a33f8-c8e7-40a0-9fc9-995351691084]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:14 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 Sep 09 14:39:14 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:14 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" returned: 0 in 0.537s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:39:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:39:14 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:39:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:14 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 Sep 09 14:39:14 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:21 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=62,cinder:SELECT=47,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:39:21 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=60,cinder:UPDATE=67,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:39:24 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4" returned: 0 in 9.563s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368, size 1024.00 MB, duration 9.57 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:39:24 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Converted 1024.00 MB image at 107.03 MB/s Sep 09 14:39:24 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:24 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 Sep 09 14:39:24 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:24 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4" returned: 0 in 0.489s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-1e114fa1-83c4-4ae1-9786-51f30462b5e4" released by "_copy_volume_from_snapshot" :: held 11.822s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Acquiring lock "cinder-quobyte-80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Deleting offline snapshot 80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 of volume 5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] snapshot_file for this snap is: volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a433ea58-f47d-4500-b8a5-4f47c32f3b5a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:24 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 Sep 09 14:39:24 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:25 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:39:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4218dc2-9f2a-431e-9a2d-0ce718031dc1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:25 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 Sep 09 14:39:25 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:25 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" returned: 0 in 0.640s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:25 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 Sep 09 14:39:25 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:26 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:26 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651 Sep 09 14:39:26 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:26 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368.80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-80cb2f80-dd44-4faa-9c5e-6b06b9ac2651" released by "_delete_snapshot" :: held 1.862s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.041s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.441s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1626247172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac384e6-dbae-4121-aa20-9062200daf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95cafb08d69498bbcbfd5a303c815be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:39:11Z,use_quota=True,user_id='49a99c511cf447ef9db165f7beda4a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Creating volume 6ac384e6-dbae-4121-aa20-9062200daf31 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:39:26 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:39:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:26 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 1073741824 Sep 09 14:39:26 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2e49d544-fdb7-4d20-ad1b-4396bf3b2ffb tempest-GroupsV314Test-202680390 None] Create group from source-group-4886d962-8a7b-4e2c-b915-f0f2d7b3197e completed successfully. Sep 09 14:39:27 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 1073741824" returned: 0 in 0.784s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:27 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 Sep 09 14:39:27 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Acquiring lock "cinder-quobyte-1e114fa1-83c4-4ae1-9786-51f30462b5e4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-1e114fa1-83c4-4ae1-9786-51f30462b5e4" acquired by "delete_volume" :: waited 0.043s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7894334-9c5d-49f6-a1f2-92736d701c5a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:27 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31" returned: 0 in 0.610s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96fb7a5-3ed8-4a5a-88da-dfe1df8080d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac384e6-dbae-4121-aa20-9062200daf31', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1506ad0b-a845-45f8-9687-82af98084499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:28 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Volume volume-6ac384e6-dbae-4121-aa20-9062200daf31 (6ac384e6-dbae-4121-aa20-9062200daf31): created successfully Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1506ad0b-a845-45f8-9687-82af98084499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Flow 'volume_create_manager' (931eabf3-5db5-4da1-ae85-f11ba7c15328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:39:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9eb30219-7947-4702-a0af-fa8fce29ddf3 tempest-DeleteServersTestJSON-236616183 None] Created volume successfully. Sep 09 14:39:28 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 Sep 09 14:39:28 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:28 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4" returned: 0 in 0.642s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:28 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4 Sep 09 14:39:28 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:28 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e114fa1-83c4-4ae1-9786-51f30462b5e4" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-1e114fa1-83c4-4ae1-9786-51f30462b5e4" released by "delete_volume" :: held 1.192s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Created reservations ['7793d66d-c7db-4e0c-8d6b-69a81a05c69e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:39:29 devstack cinder-volume[87325]: WARNING cinder.quota [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-180617738 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-180617738, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:39:29 devstack cinder-volume[87325]: WARNING cinder.quota [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-180617738 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-180617738, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Created reservations ['472283d1-dc3d-460e-a486-627c0aceb409', '1650a1a6-005e-4f5e-a1db-af9e21674f07', 'f478d42f-f9fc-4f6b-8314-fc8765265b6d', 'c143146e-057c-4137-88bd-ef8ad5f213a1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:29 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:39:29 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:29 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:29 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:39:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-097ace96-1332-40d3-afd2-cf2ecef33eec tempest-GroupsV314Test-202680390 None] Delete group completed successfully. Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Acquiring lock "cinder-quobyte-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" acquired by "delete_volume" :: waited 0.055s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87802bf-d72d-4644-b9a4-8c9dcda4a44d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:31 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 Sep 09 14:39:31 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-7a2c29de-6448-4fa6-9dfc-5c71f88bbc94 req-0ecb10e3-7464-43b5-a525-2dc3c5de3a86 tempest-DeleteServersTestJSON-236616183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-7a2c29de-6448-4fa6-9dfc-5c71f88bbc94 req-0ecb10e3-7464-43b5-a525-2dc3c5de3a86 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-7a2c29de-6448-4fa6-9dfc-5c71f88bbc94 req-0ecb10e3-7464-43b5-a525-2dc3c5de3a86 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-7a2c29de-6448-4fa6-9dfc-5c71f88bbc94 req-0ecb10e3-7464-43b5-a525-2dc3c5de3a86 tempest-DeleteServersTestJSON-236616183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-6ac384e6-dbae-4121-aa20-9062200daf31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cbc16c0-0991-41c5-bf04-5c0f35944a96', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:39:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-7a2c29de-6448-4fa6-9dfc-5c71f88bbc94 req-0ecb10e3-7464-43b5-a525-2dc3c5de3a86 tempest-DeleteServersTestJSON-236616183 None] attachment_update completed successfully. Sep 09 14:39:31 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" returned: 0 in 0.788s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:31 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368 Sep 09 14:39:31 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:32 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" returned: 0 in 0.300s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Lock "cinder-quobyte-5ea2893f-d652-4f08-97f1-7d2cbfa2b368" released by "delete_volume" :: held 1.208s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Created reservations ['18591519-c4f1-435d-a9c5-ceb6bae97c6f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Created reservations ['ddc7b380-3dd6-42be-8ff9-e1a6799d63a2', 'c32e237f-fa3a-40a0-9db1-9ac09a61d9b5', '6473f5ae-78c2-4844-ab3d-838e5b356079', '9dc85bbb-96ab-4b8a-95bf-27198b79912d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:32 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:39:32 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:32 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.315s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:32 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:39:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3f4572db-23dc-4319-8e22-ecfe853dea45 tempest-GroupsV314Test-202680390 None] Delete group completed successfully. Sep 09 14:39:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-6f2f5edd-58e9-48b8-9f91-0fa9ca449c8a req-fe0dd426-3b1b-4d5a-9988-1ed4b5960be6 tempest-DeleteServersTestJSON-236616183 None] Terminate volume connection completed successfully. Sep 09 14:39:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-6f2f5edd-58e9-48b8-9f91-0fa9ca449c8a req-fe0dd426-3b1b-4d5a-9988-1ed4b5960be6 tempest-DeleteServersTestJSON-236616183 None] Deleting attachment 3cbc16c0-0991-41c5-bf04-5c0f35944a96. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Acquiring lock "cinder-6ac384e6-dbae-4121-aa20-9062200daf31-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Lock "cinder-6ac384e6-dbae-4121-aa20-9062200daf31-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Acquiring lock "cinder-quobyte-6ac384e6-dbae-4121-aa20-9062200daf31" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Lock "cinder-quobyte-6ac384e6-dbae-4121-aa20-9062200daf31" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f878f09-2b83-49f7-84b0-fba4895a1a0e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:37 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 Sep 09 14:39:37 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:37 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31" returned: 0 in 0.442s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:37 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31 Sep 09 14:39:37 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:38 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6ac384e6-dbae-4121-aa20-9062200daf31" returned: 0 in 0.268s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Lock "cinder-quobyte-6ac384e6-dbae-4121-aa20-9062200daf31" released by "delete_volume" :: held 0.773s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Created reservations ['bd41d9e5-6475-46b2-8e1e-affb33759c52', 'd2e16b69-e96a-4c16-a9db-ec6ec9b3ae25', '37f13c5b-7bcd-4d6d-9327-68bef2ac3edf', '84f91fad-5bdf-473b-b571-567e0e8d16ce'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:38 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:39:38 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:38 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:39:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Deleted volume successfully. Sep 09 14:39:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-039c2a3b-21d8-4a80-8161-0377dd9b3320 tempest-DeleteServersTestJSON-236616183 None] Lock "cinder-6ac384e6-dbae-4121-aa20-9062200daf31-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:39:48 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=25,cinder:UPDATE=38,cinder:DELETE=1,cinder:INSERT=9 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:39:48 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=36,cinder:SELECT=39,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:39:51 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Flow 'volume_create_manager' (f6fd5c6d-5f69-4be7-a290-f7ffd757956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1340acbb-06ea-4826-b069-1bb8b162aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1340acbb-06ea-4826-b069-1bb8b162aa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1892631756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed9b501-638f-4845-b602-c475b9fe6904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd04aa7c66a84c8695d2cf51c2758cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:39:52Z,use_quota=True,user_id='74c06968e517458cb7e2418e0908af0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ae3afc-d985-4c8f-b20f-bb21c9fa08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ae3afc-d985-4c8f-b20f-bb21c9fa08cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71764a9a-ae81-4d83-8e1b-b83c03fb66a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71764a9a-ae81-4d83-8e1b-b83c03fb66a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed9b501-638f-4845-b602-c475b9fe6904', 'volume_name': 'volume-bed9b501-638f-4845-b602-c475b9fe6904', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fd5e0c-f098-46a9-945e-4f8c8d60c53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fd5e0c-f098-46a9-945e-4f8c8d60c53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bc06ae-26a1-40f9-8e1a-2c3195b4bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:52 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Volume bed9b501-638f-4845-b602-c475b9fe6904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed9b501-638f-4845-b602-c475b9fe6904', 'volume_size': 1} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1892631756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed9b501-638f-4845-b602-c475b9fe6904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd04aa7c66a84c8695d2cf51c2758cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:39:52Z,use_quota=True,user_id='74c06968e517458cb7e2418e0908af0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Creating volume bed9b501-638f-4845-b602-c475b9fe6904 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:39:52 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:52 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 1073741824 Sep 09 14:39:52 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:52 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:39:52 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:52 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.317s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:39:52 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 1073741824" returned: 0 in 0.686s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:39:52 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 Sep 09 14:39:52 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:39:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-8eeb1c85-a23e-412e-9846-698c0db8de7f req-0e67505f-dbae-47ff-84cf-e523f3211cb8 tempest-AttachVolumeNegativeTest-1886537612 None] Terminate volume connection completed successfully. Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-8eeb1c85-a23e-412e-9846-698c0db8de7f req-0e67505f-dbae-47ff-84cf-e523f3211cb8 tempest-AttachVolumeNegativeTest-1886537612 None] Deleting attachment 0494f473-9961-419b-9f21-1483a3d283a9. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:39:53 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31bc06ae-26a1-40f9-8e1a-2c3195b4bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed9b501-638f-4845-b602-c475b9fe6904', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037c404-b2b8-484e-9e09-234f46f33a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:39:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Volume volume-bed9b501-638f-4845-b602-c475b9fe6904 (bed9b501-638f-4845-b602-c475b9fe6904): created successfully Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037c404-b2b8-484e-9e09-234f46f33a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:39:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Flow 'volume_create_manager' (f6fd5c6d-5f69-4be7-a290-f7ffd757956d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:39:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d1e97a09-0747-40d6-8005-5ab5e85b4218 tempest-TaggedAttachmentsTest-396968828 None] Created volume successfully. Sep 09 14:40:03 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:40:03 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Flow 'volume_create_manager' (70dea542-800f-44d9-896b-c6b7bfe7670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c45652e-c3bf-4dcb-8330-bf409728e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c45652e-c3bf-4dcb-8330-bf409728e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-940369289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd6adba-84e5-42c4-869f-25f8f2978b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b67a7e075747edb9502e86d2e18ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:07Z,use_quota=True,user_id='322d0c5f085c4f8aa0621918f4daabda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b94ae095-c1d5-4353-84f9-e20aeee6e7a4),volume_type_id=b94ae095-c1d5-4353-84f9-e20aeee6e7a4)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3fb840-7b46-4c73-92de-a0a35cb02926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3fb840-7b46-4c73-92de-a0a35cb02926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359d1d90-0b5c-49b6-80bb-453a40e09bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359d1d90-0b5c-49b6-80bb-453a40e09bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd6adba-84e5-42c4-869f-25f8f2978b04', 'volume_name': 'volume-dfd6adba-84e5-42c4-869f-25f8f2978b04', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de6e0f9-3dd4-4be7-8460-4ccd68c8c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de6e0f9-3dd4-4be7-8460-4ccd68c8c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ebf620-859b-49b2-b3f2-b1eed6ebb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:07 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Volume dfd6adba-84e5-42c4-869f-25f8f2978b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd6adba-84e5-42c4-869f-25f8f2978b04', 'volume_size': 1} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-940369289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd6adba-84e5-42c4-869f-25f8f2978b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b67a7e075747edb9502e86d2e18ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:07Z,use_quota=True,user_id='322d0c5f085c4f8aa0621918f4daabda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b94ae095-c1d5-4353-84f9-e20aeee6e7a4),volume_type_id=b94ae095-c1d5-4353-84f9-e20aeee6e7a4)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Creating volume dfd6adba-84e5-42c4-869f-25f8f2978b04 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:40:07 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:07 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 1073741824 Sep 09 14:40:07 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:07 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 1073741824" returned: 0 in 0.622s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:07 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 Sep 09 14:40:07 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:08 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ebf620-859b-49b2-b3f2-b1eed6ebb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd6adba-84e5-42c4-869f-25f8f2978b04', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0bcc30-5272-4635-bc1e-bb39594e4ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:08 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Volume volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 (dfd6adba-84e5-42c4-869f-25f8f2978b04): created successfully Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0bcc30-5272-4635-bc1e-bb39594e4ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Flow 'volume_create_manager' (70dea542-800f-44d9-896b-c6b7bfe7670c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-008080eb-db79-424d-b3f8-4f2add61a765 tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Created volume successfully. Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:10 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:40:10 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:10 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.313s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:10 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:40:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ea31fd0a-74aa-47c7-923e-7f448c659f3f tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Retype volume completed successfully. Sep 09 14:40:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Acquiring lock "cinder-dfd6adba-84e5-42c4-869f-25f8f2978b04-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:40:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "cinder-dfd6adba-84e5-42c4-869f-25f8f2978b04-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:40:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Acquiring lock "cinder-quobyte-dfd6adba-84e5-42c4-869f-25f8f2978b04" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:40:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "cinder-quobyte-dfd6adba-84e5-42c4-869f-25f8f2978b04" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:40:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd91b58-e3f7-4243-bb72-299b42cc4aae]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:11 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 Sep 09 14:40:11 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:12 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04" returned: 0 in 0.576s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:12 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04 Sep 09 14:40:12 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:12 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfd6adba-84e5-42c4-869f-25f8f2978b04" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "cinder-quobyte-dfd6adba-84e5-42c4-869f-25f8f2978b04" released by "delete_volume" :: held 1.030s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:40:12 devstack cinder-volume[87325]: WARNING cinder.quota [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:40:12 devstack cinder-volume[87325]: WARNING cinder.quota [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Created reservations ['bb9b6c97-7469-492f-b245-26d81edcff25', 'b1e838c9-95e9-4018-aebb-67c5772553a8', '670a9da5-24d0-4bd7-b478-255732dd0664', '2e6569b1-eb6f-4329-b750-a54e8a7f0488'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:13 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:40:13 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:13 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.389s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:40:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Deleted volume successfully. Sep 09 14:40:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1a48ac2-c6d7-4fd8-9e64-8b2ffcfe5fcb tempest-VolumeRetypeWithoutMigrationTest-2114838534 None] Lock "cinder-dfd6adba-84e5-42c4-869f-25f8f2978b04-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:40:23 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=18,cinder:SELECT=13,cinder:INSERT=3 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:40:23 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Flow 'volume_create_manager' (5bfd81ec-4d57-4baa-9046-80af88be997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe86df36-da91-446c-941a-2a6b8cd150d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe86df36-da91-446c-941a-2a6b8cd150d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2003937176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12189d99-a772-4fc3-a44b-4d06eaa643e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca01f9dc184952bfddbfe2ee9b1408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:45Z,use_quota=True,user_id='ac18bde9a80c4202b8763b6b5e95c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3b66d9-f814-4872-8121-2adb8a69812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3b66d9-f814-4872-8121-2adb8a69812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f076cc-a64d-4285-bcae-ad9066700bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f076cc-a64d-4285-bcae-ad9066700bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12189d99-a772-4fc3-a44b-4d06eaa643e3', 'volume_name': 'volume-12189d99-a772-4fc3-a44b-4d06eaa643e3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2392ec-ec7f-45f3-a52e-eba06eef0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2392ec-ec7f-45f3-a52e-eba06eef0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506f1498-3769-4be8-8cf2-cef58472c4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Volume 12189d99-a772-4fc3-a44b-4d06eaa643e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12189d99-a772-4fc3-a44b-4d06eaa643e3', 'volume_size': 1} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2003937176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12189d99-a772-4fc3-a44b-4d06eaa643e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca01f9dc184952bfddbfe2ee9b1408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:45Z,use_quota=True,user_id='ac18bde9a80c4202b8763b6b5e95c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Creating volume 12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:40:44 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:40:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:44 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 1073741824 Sep 09 14:40:44 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:45 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 1073741824" returned: 0 in 0.493s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:45 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:40:45 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Flow 'volume_create_manager' (eb8e73fb-aac0-495f-b971-1cba957dcf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92fb24b-66c7-497f-8d54-1c6b0add01ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92fb24b-66c7-497f-8d54-1c6b0add01ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1106640768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272c643e-ab5f-455a-b7f3-ae7cdcd7cb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c352c27e31b48eabf97763b67028139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:46Z,use_quota=True,user_id='66ada065e9804679a92e636b6aa91008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1d0a50-7ce3-4dce-9d4f-1ef26b78ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1d0a50-7ce3-4dce-9d4f-1ef26b78ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c8c632-3552-41b1-b822-c45fcd9aeaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c8c632-3552-41b1-b822-c45fcd9aeaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272c643e-ab5f-455a-b7f3-ae7cdcd7cb42', 'volume_name': 'volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f629375d-6556-4aed-ab60-eb38ca45ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:45 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f629375d-6556-4aed-ab60-eb38ca45ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c427a16a-d726-4845-99b2-603efbd9b919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Volume 272c643e-ab5f-455a-b7f3-ae7cdcd7cb42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42', 'volume_size': 1} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.545s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1106640768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272c643e-ab5f-455a-b7f3-ae7cdcd7cb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c352c27e31b48eabf97763b67028139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:46Z,use_quota=True,user_id='66ada065e9804679a92e636b6aa91008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Creating volume 272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:40:46 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:46 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 1073741824 Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506f1498-3769-4be8-8cf2-cef58472c4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12189d99-a772-4fc3-a44b-4d06eaa643e3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:46 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17efcdec-6235-4651-b1af-756f1d4181b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Volume volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 (12189d99-a772-4fc3-a44b-4d06eaa643e3): created successfully Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17efcdec-6235-4651-b1af-756f1d4181b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Flow 'volume_create_manager' (5bfd81ec-4d57-4baa-9046-80af88be997c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1acaacf8-58c0-4436-8948-c1ffb47a2bf4 tempest-VolumesDeleteCascade-1593397815 None] Created volume successfully. Sep 09 14:40:46 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 1073741824" returned: 0 in 0.843s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:46 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 Sep 09 14:40:46 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:47 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42" returned: 0 in 0.357s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c427a16a-d726-4845-99b2-603efbd9b919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaee5b0a-7402-4378-b451-e05104512cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Volume volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 (272c643e-ab5f-455a-b7f3-ae7cdcd7cb42): created successfully Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaee5b0a-7402-4378-b451-e05104512cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Flow 'volume_create_manager' (eb8e73fb-aac0-495f-b971-1cba957dcf02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f7080c9f-be1a-424d-88e6-179516b5fa09 tempest-ServerActionsTestOtherA-1852752606 None] Created volume successfully. Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Creating offline snapshot a5db18d1-064e-44b0-b70e-4a6869e7b57e of volume 12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d33d3d-4258-4564-9657-099d08ab40ee]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:40:47 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:40:47 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Flow 'volume_create_manager' (e6a6a8db-50a5-41a4-95a3-7a3776ce0286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fed6dbb-9db9-4eea-99ba-53fef7461d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fed6dbb-9db9-4eea-99ba-53fef7461d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1853649014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440b5978-286e-422b-bacb-8bf7edf0e7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3d6b3fd36438dbaf76060ff9623a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:48Z,use_quota=True,user_id='86eeead8361c4b72a8d6660dd93c94eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b417ba9-218d-498e-bde4-049eb7b911fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b417ba9-218d-498e-bde4-049eb7b911fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e94b16-5161-47c4-95b5-951d1c801e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e94b16-5161-47c4-95b5-951d1c801e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '440b5978-286e-422b-bacb-8bf7edf0e7ae', 'volume_name': 'volume-440b5978-286e-422b-bacb-8bf7edf0e7ae', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4679244f-5761-4de2-be71-dfaa76298477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4679244f-5761-4de2-be71-dfaa76298477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dc66ab-9963-4da6-b222-02258123ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Volume 440b5978-286e-422b-bacb-8bf7edf0e7ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-440b5978-286e-422b-bacb-8bf7edf0e7ae', 'volume_size': 1} Sep 09 14:40:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:48 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.508s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-d1ddb371-204e-4e63-a9de-216116008cbc req-33b003dc-5583-439c-b95f-13110a79e60e tempest-TaggedAttachmentsTest-396968828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:48 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e 1G Sep 09 14:40:48 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:48 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e 1G" returned: 0 in 0.394s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:48 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:48 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:48 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.310s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:48 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e is being set with open permissions: ugo+rw Sep 09 14:40:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:48 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:48 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:49 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:49 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info Sep 09 14:40:49 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:49 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info" returned: 0 in 0.249s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:49 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info is being set with open permissions: ugo+rw Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:49 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info Sep 09 14:40:49 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:49 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.info" returned: 0 in 0.249s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1853649014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440b5978-286e-422b-bacb-8bf7edf0e7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3d6b3fd36438dbaf76060ff9623a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:40:48Z,use_quota=True,user_id='86eeead8361c4b72a8d6660dd93c94eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Creating volume 440b5978-286e-422b-bacb-8bf7edf0e7ae {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:40:49 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:40:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:49 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae 1073741824 Sep 09 14:40:49 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-af97682b-018e-479f-ae3b-f864bd8a464f tempest-VolumesDeleteCascade-1593397815 None] Create snapshot completed successfully Sep 09 14:40:50 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae 1073741824" returned: 0 in 0.487s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:50 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae Sep 09 14:40:50 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:50 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae" returned: 0 in 0.250s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-d1ddb371-204e-4e63-a9de-216116008cbc req-33b003dc-5583-439c-b95f-13110a79e60e tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.305s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-d1ddb371-204e-4e63-a9de-216116008cbc req-33b003dc-5583-439c-b95f-13110a79e60e tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dc66ab-9963-4da6-b222-02258123ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-440b5978-286e-422b-bacb-8bf7edf0e7ae', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd62aee-7e9f-4e32-b1c2-028c1f8b3bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:40:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Volume volume-440b5978-286e-422b-bacb-8bf7edf0e7ae (440b5978-286e-422b-bacb-8bf7edf0e7ae): created successfully Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd62aee-7e9f-4e32-b1c2-028c1f8b3bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Flow 'volume_create_manager' (e6a6a8db-50a5-41a4-95a3-7a3776ce0286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:40:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-d1ddb371-204e-4e63-a9de-216116008cbc req-33b003dc-5583-439c-b95f-13110a79e60e tempest-TaggedAttachmentsTest-396968828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-bed9b501-638f-4845-b602-c475b9fe6904', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b827da74-1570-4a32-8255-18ba4d9a195c', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:40:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d9f2532e-fc17-4006-be5d-deed968c5f1d tempest-AttachVolumeNegativeTest-1886537612 None] Created volume successfully. Sep 09 14:40:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-d1ddb371-204e-4e63-a9de-216116008cbc req-33b003dc-5583-439c-b95f-13110a79e60e tempest-TaggedAttachmentsTest-396968828 None] attachment_update completed successfully. Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Creating offline snapshot f068ca6d-81a6-4a79-bb7a-4a2388686a9b of volume 12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad918f09-d716-4d63-957e-4e8491a0ee65]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:51 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:51 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:51 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.614s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12189d99-a772-4fc3-a44b-4d06eaa643e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:40:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:51 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b 1G Sep 09 14:40:51 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:52 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:40:52 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-107479b8-9794-4135-89e4-44cdc7961f56 req-6b28258b-ba09-42db-bb80-fbfe45b7e2d8 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:40:52 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b 1G" returned: 0 in 0.714s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:52 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b Sep 09 14:40:52 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:52 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.380s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 8 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:40:52 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b" returned: 0 in 0.386s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:52 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b is being set with open permissions: ugo+rw Sep 09 14:40:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:52 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b Sep 09 14:40:52 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:53 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b" returned: 0 in 0.258s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-107479b8-9794-4135-89e4-44cdc7961f56 req-6b28258b-ba09-42db-bb80-fbfe45b7e2d8 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.958s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:40:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-107479b8-9794-4135-89e4-44cdc7961f56 req-6b28258b-ba09-42db-bb80-fbfe45b7e2d8 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:40:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-21ec6cf2-5d14-4343-a1a3-57acd795c8e6 tempest-VolumesDeleteCascade-1593397815 None] Create snapshot completed successfully Sep 09 14:40:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-107479b8-9794-4135-89e4-44cdc7961f56 req-6b28258b-ba09-42db-bb80-fbfe45b7e2d8 tempest-AttachVolumeNegativeTest-1886537612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-440b5978-286e-422b-bacb-8bf7edf0e7ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be2bbaf8-b07a-48ac-a01b-06ba660181b2', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:40:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-107479b8-9794-4135-89e4-44cdc7961f56 req-6b28258b-ba09-42db-bb80-fbfe45b7e2d8 tempest-AttachVolumeNegativeTest-1886537612 None] attachment_update completed successfully. Sep 09 14:40:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-904d464b-c20a-4d4a-8e87-cc41cbc1fb3c req-49f7dc2f-b802-420a-a4a5-86abf1298724 tempest-TaggedAttachmentsTest-396968828 None] Terminate volume connection completed successfully. Sep 09 14:40:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-904d464b-c20a-4d4a-8e87-cc41cbc1fb3c req-49f7dc2f-b802-420a-a4a5-86abf1298724 tempest-TaggedAttachmentsTest-396968828 None] Deleting attachment b827da74-1570-4a32-8255-18ba4d9a195c. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-12189d99-a772-4fc3-a44b-4d06eaa643e3-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-12189d99-a772-4fc3-a44b-4d06eaa643e3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Performing cascade delete. {{(pid=87325) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-a5db18d1-064e-44b0-b70e-4a6869e7b57e-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-a5db18d1-064e-44b0-b70e-4a6869e7b57e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-a5db18d1-064e-44b0-b70e-4a6869e7b57e" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-a5db18d1-064e-44b0-b70e-4a6869e7b57e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Deleting offline snapshot a5db18d1-064e-44b0-b70e-4a6869e7b57e of volume 12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] snapshot_file for this snap is: volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e2b2c-0940-46d3-a548-02f07e220127]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:54 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:54 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:55 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.757s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12189d99-a772-4fc3-a44b-4d06eaa643e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:40:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf7c1ad-921f-48aa-80d9-94c1e9a1b0a6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:55 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:40:55 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:56 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.575s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aac3af-bb0f-4d00-a287-bf281c23c530]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:56 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b Sep 09 14:40:56 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b" returned: 0 in 1.092s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:57 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12189d99-a772-4fc3-a44b-4d06eaa643e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:40:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e7baa-f61a-4511-83bc-a8ee79b5765f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:57 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:57 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-aed14de4-6ab5-4fef-8e19-e8dcb2077b04 req-48402a4d-c763-4057-b0db-a596020d962e tempest-AttachVolumeNegativeTest-1886537612 None] Terminate volume connection completed successfully. Sep 09 14:40:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-aed14de4-6ab5-4fef-8e19-e8dcb2077b04 req-48402a4d-c763-4057-b0db-a596020d962e tempest-AttachVolumeNegativeTest-1886537612 None] Deleting attachment be2bbaf8-b07a-48ac-a01b-06ba660181b2. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:40:58 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.805s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12189d99-a772-4fc3-a44b-4d06eaa643e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:40:58 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b998b-5946-4f9b-b6e6-28b0e282f1f1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:40:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:58 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:40:58 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.548s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:58 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:58 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:58 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:59 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.727s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:59 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e Sep 09 14:40:59 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:40:59 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Sep 09 14:40:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.a5db18d1-064e-44b0-b70e-4a6869e7b57e" returned: 0 in 0.407s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:40:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b -F qcow2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:40:59 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b -F qcow2 Sep 09 14:40:59 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:00 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b -F qcow2" returned: 0 in 0.865s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-a5db18d1-064e-44b0-b70e-4a6869e7b57e" released by "_delete_snapshot" :: held 6.135s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" released by "delete_snapshot" :: held 6.179s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:00 devstack cinder-volume[87325]: WARNING cinder.quota [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:41:00 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Created reservations ['aa711439-bcb2-4ba1-b63f-fbcfa1be50b5', '75a3be4e-75e6-4918-815a-fd31deb6b63f', '863c1260-fc2c-4437-8579-30a21fce4835', '2d96232d-089d-4c90-8768-9959de86edc5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Delete snapshot completed successfully. Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-a5db18d1-064e-44b0-b70e-4a6869e7b57e-delete_snapshot" released by "delete_snapshot" :: held 6.631s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-f068ca6d-81a6-4a79-bb7a-4a2388686a9b-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-f068ca6d-81a6-4a79-bb7a-4a2388686a9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-f068ca6d-81a6-4a79-bb7a-4a2388686a9b" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-f068ca6d-81a6-4a79-bb7a-4a2388686a9b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Deleting offline snapshot f068ca6d-81a6-4a79-bb7a-4a2388686a9b of volume 12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] snapshot_file for this snap is: volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5524f3-e97a-4a92-aeaa-0fcd586bd8fb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:01 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b Sep 09 14:41:01 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:02 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b" returned: 0 in 0.808s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12189d99-a772-4fc3-a44b-4d06eaa643e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:41:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca30dee7-7ce1-4556-b5be-77f47571bcc1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:02 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:41:02 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:03 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.674s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:03 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b Sep 09 14:41:03 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:03 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b" returned: 0 in 0.766s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:03 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b Sep 09 14:41:03 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:04 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3.f068ca6d-81a6-4a79-bb7a-4a2388686a9b" returned: 0 in 0.330s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-f068ca6d-81a6-4a79-bb7a-4a2388686a9b" released by "_delete_snapshot" :: held 2.865s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" released by "delete_snapshot" :: held 2.911s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Created reservations ['6930c37c-1101-42a2-80d1-d5e862810af5', 'b9bd83b8-9d41-42b8-9240-f6912881f227', '44eab22a-6a89-4139-b7ce-57f986b8b9ef', '3eeb828a-a639-4842-b033-4e0c1328c236'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:04 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Delete snapshot completed successfully. Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-f068ca6d-81a6-4a79-bb7a-4a2388686a9b-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Snapshots deleted, issuing volume delete {{(pid=87325) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b0951-ac14-4bd6-b39f-42830640a482]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:04 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:41:04 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:05 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.585s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:05 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3 Sep 09 14:41:05 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:05 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-12189d99-a772-4fc3-a44b-4d06eaa643e3" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-12189d99-a772-4fc3-a44b-4d06eaa643e3" released by "delete_volume" :: held 1.200s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Created reservations ['202c56c5-48b9-41a6-960e-548cfaeff726', 'addcd8d3-9c88-40d2-b92e-e9600c8166ac', '69e9ec45-fb18-4237-8c8b-e1865aea20be', '02c4ca17-a42b-4cb9-889e-76cf6ce8577c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:05 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:05 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:06 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.301s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:06 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Deleted volume successfully. Sep 09 14:41:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-19c68fdb-a5ba-4d0e-878c-def837525562 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-12189d99-a772-4fc3-a44b-4d06eaa643e3-delete_volume" released by "delete_volume" :: held 11.906s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Flow 'volume_create_manager' (cbea003a-b606-4f4d-b2a5-fa4af075c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b52cba-45ab-4ab2-92c2-84539afaaa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b52cba-45ab-4ab2-92c2-84539afaaa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-372232277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276fd60a-edd9-4ff5-a668-8f08a1f7d803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca01f9dc184952bfddbfe2ee9b1408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:08Z,use_quota=True,user_id='ac18bde9a80c4202b8763b6b5e95c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad12d7f-d11e-4e8c-86d9-f0cc0df7a400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad12d7f-d11e-4e8c-86d9-f0cc0df7a400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8532899a-20bb-4b2d-a7dc-320bfc564320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8532899a-20bb-4b2d-a7dc-320bfc564320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276fd60a-edd9-4ff5-a668-8f08a1f7d803', 'volume_name': 'volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c0bc23-965b-41d7-b664-534ff4426ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c0bc23-965b-41d7-b664-534ff4426ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843c848e-8fd5-4729-b0f4-2d8eac15b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:08 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Volume 276fd60a-edd9-4ff5-a668-8f08a1f7d803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803', 'volume_size': 1} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-372232277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276fd60a-edd9-4ff5-a668-8f08a1f7d803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca01f9dc184952bfddbfe2ee9b1408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:08Z,use_quota=True,user_id='ac18bde9a80c4202b8763b6b5e95c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Creating volume 276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:08 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:08 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 1073741824 Sep 09 14:41:08 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:08 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 1073741824" returned: 0 in 0.501s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:08 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 Sep 09 14:41:08 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:09 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803" returned: 0 in 0.434s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843c848e-8fd5-4729-b0f4-2d8eac15b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fa104c-dea2-4e81-8cb1-7e1842a254aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:09 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Volume volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 (276fd60a-edd9-4ff5-a668-8f08a1f7d803): created successfully Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fa104c-dea2-4e81-8cb1-7e1842a254aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Flow 'volume_create_manager' (cbea003a-b606-4f4d-b2a5-fa4af075c63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:09 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-59620dd0-be03-49d3-8067-398ac781c9b1 tempest-VolumesDeleteCascade-1593397815 None] Created volume successfully. Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Acquiring lock "cinder-bed9b501-638f-4845-b602-c475b9fe6904-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Lock "cinder-bed9b501-638f-4845-b602-c475b9fe6904-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Acquiring lock "cinder-quobyte-bed9b501-638f-4845-b602-c475b9fe6904" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Lock "cinder-quobyte-bed9b501-638f-4845-b602-c475b9fe6904" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[627f1038-51b2-4369-ba7a-c88d24b8a9f5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:09 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 Sep 09 14:41:09 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Creating offline snapshot f88f7b8c-2f19-4d81-a206-6276e9d37c4d of volume 276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:41:10 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904" returned: 0 in 0.406s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0771497c-e6c9-4d2f-9c31-6b318eefd18c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:10 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904 Sep 09 14:41:10 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:10 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 Sep 09 14:41:10 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:10 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bed9b501-638f-4845-b602-c475b9fe6904" returned: 0 in 0.278s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Lock "cinder-quobyte-bed9b501-638f-4845-b602-c475b9fe6904" released by "delete_volume" :: held 0.729s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Created reservations ['954cc563-29b3-4821-a38f-ad280e7779b6', '501fcb3b-7775-425d-b410-0c1757a3080d', '89553ff7-8476-46ee-b4c9-6e2e039b132a', '84efdfde-ea41-4961-89ee-f67b20713eea'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:10 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803" returned: 0 in 0.426s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:10 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:10 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:10 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d 1G Sep 09 14:41:10 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:10 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.272s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Deleted volume successfully. Sep 09 14:41:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0af86ac1-e4ed-4c59-87cd-f578025bcec9 tempest-TaggedAttachmentsTest-396968828 None] Lock "cinder-bed9b501-638f-4845-b602-c475b9fe6904-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:11 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d 1G" returned: 0 in 0.438s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:11 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d Sep 09 14:41:11 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:11 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:11 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d is being set with open permissions: ugo+rw Sep 09 14:41:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:11 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d Sep 09 14:41:11 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:11 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:11 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info Sep 09 14:41:11 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:12 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:12 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info is being set with open permissions: ugo+rw Sep 09 14:41:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:12 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info Sep 09 14:41:12 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:12 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.info" returned: 0 in 0.295s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6330a0e3-3b1e-4f83-86eb-74ea08bc9b08 tempest-VolumesDeleteCascade-1593397815 None] Create snapshot completed successfully Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Flow 'volume_create_manager' (89d1c4a8-f092-48ff-80a2-2192d61fc7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eb4a3a-050b-435a-ab62-467f0b608681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eb4a3a-050b-435a-ab62-467f0b608681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-33389335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327c0ac2-d79c-44ca-91c2-83e5ad56823d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ca01f9dc184952bfddbfe2ee9b1408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f88f7b8c-2f19-4d81-a206-6276e9d37c4d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:14Z,use_quota=True,user_id='ac18bde9a80c4202b8763b6b5e95c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbef291-fb23-43ae-8e5f-706e8be1e6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbef291-fb23-43ae-8e5f-706e8be1e6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd2337b-4705-4d25-a718-51e707e3d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd2337b-4705-4d25-a718-51e707e3d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '327c0ac2-d79c-44ca-91c2-83e5ad56823d', 'volume_name': 'volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d', 'volume_size': 1, 'snapshot_id': 'f88f7b8c-2f19-4d81-a206-6276e9d37c4d'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6486a931-ac54-4597-9189-6124251b4b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6486a931-ac54-4597-9189-6124251b4b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870c517-0076-4d87-a681-f6a21cd4b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:14 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Volume 327c0ac2-d79c-44ca-91c2-83e5ad56823d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d', 'volume_size': 1, 'snapshot_id': 'f88f7b8c-2f19-4d81-a206-6276e9d37c4d'} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-f88f7b8c-2f19-4d81-a206-6276e9d37c4d-327c0ac2-d79c-44ca-91c2-83e5ad56823d" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-f88f7b8c-2f19-4d81-a206-6276e9d37c4d-327c0ac2-d79c-44ca-91c2-83e5ad56823d" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Creating volume 327c0ac2-d79c-44ca-91c2-83e5ad56823d from snapshot f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-327c0ac2-d79c-44ca-91c2-83e5ad56823d" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-327c0ac2-d79c-44ca-91c2-83e5ad56823d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] snapshot: f88f7b8c-2f19-4d81-a206-6276e9d37c4d, volume: 327c0ac2-d79c-44ca-91c2-83e5ad56823d, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb0332-c040-4b38-984a-ecd19025de84]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:14 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d Sep 09 14:41:14 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:14 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d" returned: 0 in 0.397s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fa1e80-0b4e-437f-a5bd-a6a5d8cd28a8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:14 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 Sep 09 14:41:14 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:15 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803" returned: 0 in 0.392s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:41:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:41:15 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:41:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:15 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d Sep 09 14:41:15 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:24 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d" returned: 0 in 8.993s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:41:24 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Converted 1024.00 MB image at 113.84 MB/s Sep 09 14:41:24 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d is being set with open permissions: ugo+rw Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:24 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d Sep 09 14:41:24 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=48,cinder:SELECT=54,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=56,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:41:24 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-327c0ac2-d79c-44ca-91c2-83e5ad56823d" released by "_copy_volume_from_snapshot" :: held 10.254s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-f88f7b8c-2f19-4d81-a206-6276e9d37c4d-327c0ac2-d79c-44ca-91c2-83e5ad56823d" released by "_create_volume_from_snapshot" :: held 10.478s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.513s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870c517-0076-4d87-a681-f6a21cd4b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d', 'volume_size': 1, 'snapshot_id': 'f88f7b8c-2f19-4d81-a206-6276e9d37c4d'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cb7a94-8657-4f06-b48d-45374819bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Volume volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d (327c0ac2-d79c-44ca-91c2-83e5ad56823d): created successfully Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cb7a94-8657-4f06-b48d-45374819bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Flow 'volume_create_manager' (89d1c4a8-f092-48ff-80a2-2192d61fc7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ba8a4aab-de28-4f6d-9e5a-98720408efae tempest-VolumesDeleteCascade-1593397815 None] Created volume successfully. Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-276fd60a-edd9-4ff5-a668-8f08a1f7d803-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-276fd60a-edd9-4ff5-a668-8f08a1f7d803-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Performing cascade delete. {{(pid=87325) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-f88f7b8c-2f19-4d81-a206-6276e9d37c4d-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-f88f7b8c-2f19-4d81-a206-6276e9d37c4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-276fd60a-edd9-4ff5-a668-8f08a1f7d803" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-276fd60a-edd9-4ff5-a668-8f08a1f7d803" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-f88f7b8c-2f19-4d81-a206-6276e9d37c4d" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-f88f7b8c-2f19-4d81-a206-6276e9d37c4d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Deleting offline snapshot f88f7b8c-2f19-4d81-a206-6276e9d37c4d of volume 276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] snapshot_file for this snap is: volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa0ebaa-6011-4e0e-9984-01835021587d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:26 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d Sep 09 14:41:26 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:26 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d" returned: 0 in 0.577s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[942da98a-a3d0-4f74-998f-69919a2222ea]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b77ac483-182c-4af4-8004-c10495a5fed2 req-727e4081-f58f-4c5b-8ac8-8b242c36c501 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b77ac483-182c-4af4-8004-c10495a5fed2 req-727e4081-f58f-4c5b-8ac8-8b242c36c501 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b77ac483-182c-4af4-8004-c10495a5fed2 req-727e4081-f58f-4c5b-8ac8-8b242c36c501 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:26 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 Sep 09 14:41:26 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-b77ac483-182c-4af4-8004-c10495a5fed2 req-727e4081-f58f-4c5b-8ac8-8b242c36c501 tempest-ServerActionsTestOtherA-1852752606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74185237-7756-4104-935a-9efe302236e6', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:41:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-b77ac483-182c-4af4-8004-c10495a5fed2 req-727e4081-f58f-4c5b-8ac8-8b242c36c501 tempest-ServerActionsTestOtherA-1852752606 None] attachment_update completed successfully. Sep 09 14:41:27 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803" returned: 0 in 0.672s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:27 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d Sep 09 14:41:27 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:27 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d" returned: 0 in 0.672s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:28 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d Sep 09 14:41:28 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:28 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803.f88f7b8c-2f19-4d81-a206-6276e9d37c4d" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-f88f7b8c-2f19-4d81-a206-6276e9d37c4d" released by "_delete_snapshot" :: held 2.360s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-276fd60a-edd9-4ff5-a668-8f08a1f7d803" released by "delete_snapshot" :: held 2.395s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Created reservations ['2a2e6492-db9f-4164-9129-96f8113b9c34', 'a80b62cc-9076-424e-9ad0-82d1e765feeb', '3069e44b-6a7c-474e-9a1c-3eb0645e04fb', 'a8832cf0-447e-4075-b91d-1222017592cc'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Delete snapshot completed successfully. Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-f88f7b8c-2f19-4d81-a206-6276e9d37c4d-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Snapshots deleted, issuing volume delete {{(pid=87325) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-276fd60a-edd9-4ff5-a668-8f08a1f7d803" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-276fd60a-edd9-4ff5-a668-8f08a1f7d803" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480b241-f2d1-4510-995c-f6b237ca07c6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:28 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 Sep 09 14:41:28 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:29 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803" returned: 0 in 0.586s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:29 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803 Sep 09 14:41:29 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:29 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-276fd60a-edd9-4ff5-a668-8f08a1f7d803" returned: 0 in 0.327s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-276fd60a-edd9-4ff5-a668-8f08a1f7d803" released by "delete_volume" :: held 0.972s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Created reservations ['12700673-f81a-4009-b41e-0bfeac521916', 'f8b60bdb-9bae-4951-8d24-d54ea9fe181d', 'a37e6685-1bf7-4dd7-93db-e625ee5f98c5', '06bb3c17-cc94-4fd9-9f61-a5367cae78aa'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:29 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:29 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:30 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.460s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Deleted volume successfully. Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58c32183-2861-4efb-a5a2-3e08dad769a2 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-276fd60a-edd9-4ff5-a668-8f08a1f7d803-delete_volume" released by "delete_volume" :: held 4.470s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-327c0ac2-d79c-44ca-91c2-83e5ad56823d-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-327c0ac2-d79c-44ca-91c2-83e5ad56823d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "cinder-quobyte-327c0ac2-d79c-44ca-91c2-83e5ad56823d" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-327c0ac2-d79c-44ca-91c2-83e5ad56823d" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb95bfd-d616-40f6-bd1b-f04381eef8f1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:30 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d Sep 09 14:41:30 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:31 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d" returned: 0 in 0.492s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-4c121b6f-504b-43f5-9875-4da88c5380a2 tempest-ServerActionsTestOtherA-1852752606 None] Terminate volume connection completed successfully. Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-4c121b6f-504b-43f5-9875-4da88c5380a2 tempest-ServerActionsTestOtherA-1852752606 None] Deleting attachment 74185237-7756-4104-935a-9efe302236e6. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:41:31 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d Sep 09 14:41:31 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:31 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-327c0ac2-d79c-44ca-91c2-83e5ad56823d" returned: 0 in 0.339s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-quobyte-327c0ac2-d79c-44ca-91c2-83e5ad56823d" released by "delete_volume" :: held 0.908s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Created reservations ['5f3f6d67-4dfd-4952-a967-a2615c6989ab', 'dabaa1b2-f0e9-4973-8e88-6f6db3c8324f', 'db3e6191-d688-4c13-8a76-632167871b4a', 'd2481c77-84dd-423b-ace6-150b7dec3aa6'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:31 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:31 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:32 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Deleted volume successfully. Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ef9a8e-1cc2-4ac8-88ed-1f9c04e36ab3 tempest-VolumesDeleteCascade-1593397815 None] Lock "cinder-327c0ac2-d79c-44ca-91c2-83e5ad56823d-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-c086aea9-de33-45c8-91ba-a02cc852caa9 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-c086aea9-de33-45c8-91ba-a02cc852caa9 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-c086aea9-de33-45c8-91ba-a02cc852caa9 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-c086aea9-de33-45c8-91ba-a02cc852caa9 tempest-ServerActionsTestOtherA-1852752606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8a29a92-8f64-437e-a8ce-b9548bd5d777', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:41:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-2944e2aa-982e-4607-8b34-5617ccfee3f1 req-c086aea9-de33-45c8-91ba-a02cc852caa9 tempest-ServerActionsTestOtherA-1852752606 None] attachment_update completed successfully. Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Flow 'volume_create_manager' (2bed6353-463a-41ad-ba39-243c4191493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df289a10-bb6d-4c2c-977b-110cb4a15d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df289a10-bb6d-4c2c-977b-110cb4a15d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1247335491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dac61f-8379-4dc9-9152-426586171948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd2c1480d194ff28048542f20f3a006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:37Z,use_quota=True,user_id='0af63c72ef614fba801483395f18c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1492b432-92c1-4f33-a93b-f9dc41905c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1492b432-92c1-4f33-a93b-f9dc41905c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a23843-a108-4727-8546-65669f4fa52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a23843-a108-4727-8546-65669f4fa52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4dac61f-8379-4dc9-9152-426586171948', 'volume_name': 'volume-e4dac61f-8379-4dc9-9152-426586171948', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4913d877-2350-4a58-a537-14c87353ed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4913d877-2350-4a58-a537-14c87353ed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a1667d-2b57-44f9-abca-9676eae8e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:37 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Volume e4dac61f-8379-4dc9-9152-426586171948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4dac61f-8379-4dc9-9152-426586171948', 'volume_size': 1} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1247335491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dac61f-8379-4dc9-9152-426586171948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd2c1480d194ff28048542f20f3a006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:37Z,use_quota=True,user_id='0af63c72ef614fba801483395f18c207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Creating volume e4dac61f-8379-4dc9-9152-426586171948 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:37 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:41:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:37 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 1073741824 Sep 09 14:41:37 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:38 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 1073741824" returned: 0 in 0.861s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:38 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 Sep 09 14:41:38 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:38 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a1667d-2b57-44f9-abca-9676eae8e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dac61f-8379-4dc9-9152-426586171948', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adaf35a4-bdd8-4897-9699-c9a4e1691a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Volume volume-e4dac61f-8379-4dc9-9152-426586171948 (e4dac61f-8379-4dc9-9152-426586171948): created successfully Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adaf35a4-bdd8-4897-9699-c9a4e1691a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Flow 'volume_create_manager' (2bed6353-463a-41ad-ba39-243c4191493c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2b5e540b-df08-4cc4-b891-efae17e66df6 tempest-VolumesMetadataTest-5595440 None] Created volume successfully. Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Acquiring lock "cinder-e4dac61f-8379-4dc9-9152-426586171948-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Lock "cinder-e4dac61f-8379-4dc9-9152-426586171948-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Acquiring lock "cinder-quobyte-e4dac61f-8379-4dc9-9152-426586171948" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Lock "cinder-quobyte-e4dac61f-8379-4dc9-9152-426586171948" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bc2413-5195-452f-8823-a0953f2acd24]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:40 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 Sep 09 14:41:40 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:40 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948" returned: 0 in 0.411s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:40 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948 Sep 09 14:41:40 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:41 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e4dac61f-8379-4dc9-9152-426586171948" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Lock "cinder-quobyte-e4dac61f-8379-4dc9-9152-426586171948" released by "delete_volume" :: held 0.733s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Created reservations ['9da72e35-3057-46a5-9cf3-779c50c31272', 'cd2150cc-fef3-47b6-aa67-5fd657ba4131', 'fd4c9883-6a03-4c1b-86b3-09cc0061c8e1', '3b1bcb07-e157-472e-a267-a9b90cde0f52'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:41 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:41 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:41 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.256s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Deleted volume successfully. Sep 09 14:41:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d22aed65-8ae7-4d5b-a71d-2ca1b5e39fd7 tempest-VolumesMetadataTest-5595440 None] Lock "cinder-e4dac61f-8379-4dc9-9152-426586171948-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Flow 'volume_create_manager' (dd5d5bb1-405f-40fc-be59-8459f06bef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f329d8-f9e1-4974-8cb0-7bbe7121e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f329d8-f9e1-4974-8cb0-7bbe7121e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1447133670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8faf9ee8-ec80-4c8a-9e96-fb4f76c13958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3d6b3fd36438dbaf76060ff9623a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:45Z,use_quota=True,user_id='86eeead8361c4b72a8d6660dd93c94eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305cfadd-2268-468d-a548-19b6f07b337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305cfadd-2268-468d-a548-19b6f07b337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f036301-9cd2-488f-b1a8-a23c31ed354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f036301-9cd2-488f-b1a8-a23c31ed354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8faf9ee8-ec80-4c8a-9e96-fb4f76c13958', 'volume_name': 'volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a494825-a49d-441e-892c-513aa1cd585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a494825-a49d-441e-892c-513aa1cd585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8c89eb-2a3f-4948-a072-bfb1293ae917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:45 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Volume 8faf9ee8-ec80-4c8a-9e96-fb4f76c13958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958', 'volume_size': 1} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1447133670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8faf9ee8-ec80-4c8a-9e96-fb4f76c13958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3d6b3fd36438dbaf76060ff9623a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:45Z,use_quota=True,user_id='86eeead8361c4b72a8d6660dd93c94eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Creating volume 8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:45 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:41:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:45 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 1073741824 Sep 09 14:41:45 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:46 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 1073741824" returned: 0 in 0.655s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:46 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 Sep 09 14:41:46 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:46 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8c89eb-2a3f-4948-a072-bfb1293ae917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3ea157-c39e-48f4-b124-5f8bc1e33436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Volume volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 (8faf9ee8-ec80-4c8a-9e96-fb4f76c13958): created successfully Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3ea157-c39e-48f4-b124-5f8bc1e33436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Flow 'volume_create_manager' (dd5d5bb1-405f-40fc-be59-8459f06bef0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-10bab6d3-4306-4175-869e-b9f15719b8b8 tempest-AttachVolumeNegativeTest-1886537612 None] Created volume successfully. Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (d520f1e7-5202-4f7e-a656-f9f59564fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c56747-f41a-4802-83e1-852d54ef5a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c56747-f41a-4802-83e1-852d54ef5a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-945540835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895c3c29-b52a-48a2-bd58-04a35b50cad8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:47Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255791b3-ae3e-49d4-a7a0-106fcd4946eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255791b3-ae3e-49d4-a7a0-106fcd4946eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fab751-a869-418e-9e15-456bdb8d8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fab751-a869-418e-9e15-456bdb8d8687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895c3c29-b52a-48a2-bd58-04a35b50cad8', 'volume_name': 'volume-895c3c29-b52a-48a2-bd58-04a35b50cad8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126a8250-11ec-4b03-857f-7b6795fb70c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126a8250-11ec-4b03-857f-7b6795fb70c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710db4dc-f512-4f84-ad1b-c66316467460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Volume 895c3c29-b52a-48a2-bd58-04a35b50cad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895c3c29-b52a-48a2-bd58-04a35b50cad8', 'volume_size': 1} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-945540835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895c3c29-b52a-48a2-bd58-04a35b50cad8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:47Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Creating volume 895c3c29-b52a-48a2-bd58-04a35b50cad8 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:46 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:41:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:46 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 1073741824 Sep 09 14:41:46 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:47 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 1073741824" returned: 0 in 0.668s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:47 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 Sep 09 14:41:47 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:48 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710db4dc-f512-4f84-ad1b-c66316467460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895c3c29-b52a-48a2-bd58-04a35b50cad8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351d7b0a-02e8-49b7-bdab-44c9664647e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:48 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Volume volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 (895c3c29-b52a-48a2-bd58-04a35b50cad8): created successfully Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351d7b0a-02e8-49b7-bdab-44c9664647e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (d520f1e7-5202-4f7e-a656-f9f59564fe13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-28faffcf-4503-47dc-9aaf-9ecd071e3885 tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-6f3b6185-6c89-4baf-9c12-8e6feafdc561 req-a4409898-c06f-40b5-bbd3-9bfdcd1336d7 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-6f3b6185-6c89-4baf-9c12-8e6feafdc561 req-a4409898-c06f-40b5-bbd3-9bfdcd1336d7 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-6f3b6185-6c89-4baf-9c12-8e6feafdc561 req-a4409898-c06f-40b5-bbd3-9bfdcd1336d7 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-6f3b6185-6c89-4baf-9c12-8e6feafdc561 req-a4409898-c06f-40b5-bbd3-9bfdcd1336d7 tempest-AttachVolumeNegativeTest-1886537612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dbdd999-9869-460b-83a1-91b5f1e136e4', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:41:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-6f3b6185-6c89-4baf-9c12-8e6feafdc561 req-a4409898-c06f-40b5-bbd3-9bfdcd1336d7 tempest-AttachVolumeNegativeTest-1886537612 None] attachment_update completed successfully. Sep 09 14:41:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-5da82235-ad81-4682-a19f-4abbb8ada1b6 req-45cd975b-8447-417c-8640-129d163289e9 tempest-AttachVolumeNegativeTest-1886537612 None] Terminate volume connection completed successfully. Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-5da82235-ad81-4682-a19f-4abbb8ada1b6 req-45cd975b-8447-417c-8640-129d163289e9 tempest-AttachVolumeNegativeTest-1886537612 None] Deleting attachment 6dbdd999-9869-460b-83a1-91b5f1e136e4. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (9ec88b0c-e61f-4a8c-9fa9-0103b1ba617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bdf3c4-d49e-4248-9f2c-fac85b119b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1bdf3c4-d49e-4248-9f2c-fac85b119b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1969191327',display_name='tempest-VolumesGetTest-Volume-252484223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2e13d5-d07e-444e-8d15-9da4cdca5f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:50Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a8b92b-96c7-4f24-a5dc-febde31a9dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a8b92b-96c7-4f24-a5dc-febde31a9dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a532f8d3-b5ed-40e8-9011-01bc6fcebaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a532f8d3-b5ed-40e8-9011-01bc6fcebaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2e13d5-d07e-444e-8d15-9da4cdca5f28', 'volume_name': 'volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57467ce-0fbb-4764-88a9-4ef2ad2f11bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57467ce-0fbb-4764-88a9-4ef2ad2f11bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3946d15-7fb5-4edf-a6ec-5432ee9828fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Volume de2e13d5-d07e-444e-8d15-9da4cdca5f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28', 'volume_size': 1} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1969191327',display_name='tempest-VolumesGetTest-Volume-252484223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2e13d5-d07e-444e-8d15-9da4cdca5f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:50Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Creating volume de2e13d5-d07e-444e-8d15-9da4cdca5f28 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:50 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:41:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:50 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 1073741824 Sep 09 14:41:50 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:51 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 1073741824" returned: 0 in 0.562s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:51 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 Sep 09 14:41:51 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:51 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28" returned: 0 in 0.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3946d15-7fb5-4edf-a6ec-5432ee9828fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162433e7-dd5e-4e4d-80ca-87566a079eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Volume volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 (de2e13d5-d07e-444e-8d15-9da4cdca5f28): created successfully Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162433e7-dd5e-4e4d-80ca-87566a079eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (9ec88b0c-e61f-4a8c-9fa9-0103b1ba617c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1da2a242-b99c-49f6-9794-cdc533194e9a tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:52 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:52 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:52 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.536s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 8 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-de2e13d5-d07e-444e-8d15-9da4cdca5f28-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Lock "cinder-de2e13d5-d07e-444e-8d15-9da4cdca5f28-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-de2e13d5-d07e-444e-8d15-9da4cdca5f28" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-de2e13d5-d07e-444e-8d15-9da4cdca5f28" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281c151-6405-456b-9f25-b0e456418ad2]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:53 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 Sep 09 14:41:53 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:53 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28" returned: 0 in 0.573s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:53 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28 Sep 09 14:41:53 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:54 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-de2e13d5-d07e-444e-8d15-9da4cdca5f28" returned: 0 in 0.467s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-de2e13d5-d07e-444e-8d15-9da4cdca5f28" released by "delete_volume" :: held 1.119s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Created reservations ['7d3f2792-4156-464e-b22e-c2b72bd32cf5', 'cbbe00dc-99af-4d30-989d-0b9c86ab131c', 'ae0280d6-1bc3-49e8-be3c-e67c2236274b', '4b6aae8e-939f-41e1-93db-a4026a4948d7'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:54 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:54 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:54 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.434s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:54 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:41:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25540cf7-6aed-49bb-a733-6ad404258b68 tempest-VolumesGetTest-1543688942 None] Lock "cinder-de2e13d5-d07e-444e-8d15-9da4cdca5f28-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-895c3c29-b52a-48a2-bd58-04a35b50cad8-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Lock "cinder-895c3c29-b52a-48a2-bd58-04a35b50cad8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-895c3c29-b52a-48a2-bd58-04a35b50cad8" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-895c3c29-b52a-48a2-bd58-04a35b50cad8" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d79563-a91b-4a36-bacc-a0be6090c02b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:55 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 Sep 09 14:41:55 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:55 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8" returned: 0 in 0.448s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:55 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8 Sep 09 14:41:55 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:56 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-895c3c29-b52a-48a2-bd58-04a35b50cad8" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-895c3c29-b52a-48a2-bd58-04a35b50cad8" released by "delete_volume" :: held 0.795s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Created reservations ['c10abda7-e5c2-4e39-991e-c548bef1b3c0', 'ee8b7c8b-f233-4a65-85dd-67e395527bea', '882a4127-cc2e-43db-a1d1-6d2e983f0d32', '422051bb-878f-4a24-83da-d381ad6fdfdc'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:56 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:41:56 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:56 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.604s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:41:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:41:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-85b6e458-fb4c-45a7-b226-d1aa0bc1e1bb tempest-VolumesGetTest-1543688942 None] Lock "cinder-895c3c29-b52a-48a2-bd58-04a35b50cad8-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (be5ba1cd-65a5-44d9-9db3-1f73ba07f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f476f205-8884-4aa2-83f8-6f64a03c1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f476f205-8884-4aa2-83f8-6f64a03c1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1392034605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af6820-48c5-4171-b97a-1474265744d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:58Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db2886d-1d0e-49d5-894b-523638c92482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db2886d-1d0e-49d5-894b-523638c92482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110e2c47-df04-4be6-98a4-19846d9e9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110e2c47-df04-4be6-98a4-19846d9e9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0af6820-48c5-4171-b97a-1474265744d7', 'volume_name': 'volume-f0af6820-48c5-4171-b97a-1474265744d7', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fb1c1d-9ba8-4990-9d66-dbd6c715747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fb1c1d-9ba8-4990-9d66-dbd6c715747a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd6bdc-f84b-47fd-83d2-e7045265b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:57 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Volume f0af6820-48c5-4171-b97a-1474265744d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0af6820-48c5-4171-b97a-1474265744d7', 'volume_size': 1} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1392034605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af6820-48c5-4171-b97a-1474265744d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:41:58Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Creating volume f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:41:57 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:41:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:57 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 1073741824 Sep 09 14:41:57 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:58 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 1073741824" returned: 0 in 1.091s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:59 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 Sep 09 14:41:59 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "cinder-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "cinder-quobyte-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-quobyte-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958" acquired by "delete_volume" :: waited 0.048s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:41:59 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7" returned: 0 in 0.717s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be416c2-68c1-4f11-b580-e21d6172edbd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8dd6bdc-f84b-47fd-83d2-e7045265b705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af6820-48c5-4171-b97a-1474265744d7', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9c395e-652c-41e1-9d51-28e80c9f9e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:41:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Volume volume-f0af6820-48c5-4171-b97a-1474265744d7 (f0af6820-48c5-4171-b97a-1474265744d7): created successfully Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9c395e-652c-41e1-9d51-28e80c9f9e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:41:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (be5ba1cd-65a5-44d9-9db3-1f73ba07f507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:41:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f2bf36d3-2739-4932-8159-a0f625e32fc5 tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:41:59 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 Sep 09 14:41:59 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:00 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958" returned: 0 in 0.786s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:00 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958 Sep 09 14:42:00 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:01 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958" returned: 0 in 0.565s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-quobyte-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958" released by "delete_volume" :: held 1.518s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Created reservations ['45c004a9-3710-418b-b40e-b2d5bd732f8e', 'bdaa72a9-2367-419d-a0ed-540472529d75', 'f52082d6-962e-4c50-bc00-6c663206c0cd', 'a5de9388-e61b-4b45-988f-d52b198fee19'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:01 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:01 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:02 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.570s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Deleted volume successfully. Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a86b62b3-a61d-4ebd-b883-cff0e9ef40a1 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-8faf9ee8-ec80-4c8a-9e96-fb4f76c13958-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (f3cb2bf7-98ea-4dea-8c0b-d15659a78465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4624d213-b3a3-4717-9e80-8c5af4a31e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "cinder-440b5978-286e-422b-bacb-8bf7edf0e7ae-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-440b5978-286e-422b-bacb-8bf7edf0e7ae-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4624d213-b3a3-4717-9e80-8c5af4a31e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-723184140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51d927a-9bd1-4467-9f06-78faa0e5f4e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f0af6820-48c5-4171-b97a-1474265744d7,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:02Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3605fdc-2e34-4f42-ab74-ce02fa986cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3605fdc-2e34-4f42-ab74-ce02fa986cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc394f3-6fa7-456b-8f75-786ea491dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc394f3-6fa7-456b-8f75-786ea491dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e51d927a-9bd1-4467-9f06-78faa0e5f4e0', 'volume_name': 'volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0', 'volume_size': 1, 'source_volid': 'f0af6820-48c5-4171-b97a-1474265744d7', 'source_volstatus': 'available'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c02c42-ab78-4dae-ab92-022de964d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c02c42-ab78-4dae-ab92-022de964d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5757dc-4403-493d-8bf4-309167ab9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:02 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Volume e51d927a-9bd1-4467-9f06-78faa0e5f4e0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0', 'volume_size': 1, 'source_volid': 'f0af6820-48c5-4171-b97a-1474265744d7', 'source_volstatus': 'available'} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:03 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Cloning volume f0af6820-48c5-4171-b97a-1474265744d7 to volume e51d927a-9bd1-4467-9f06-78faa0e5f4e0 Sep 09 14:42:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-400fd4be-2f68-4d5b-8ee5-ed0098543a17 req-3554fed9-048d-4d6a-a3ee-ce098e237bd9 tempest-ServerActionsTestOtherA-1852752606 None] Terminate volume connection completed successfully. Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-400fd4be-2f68-4d5b-8ee5-ed0098543a17 req-3554fed9-048d-4d6a-a3ee-ce098e237bd9 tempest-ServerActionsTestOtherA-1852752606 None] Deleting attachment b8a29a92-8f64-437e-a8ce-b9548bd5d777. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "cinder-quobyte-440b5978-286e-422b-bacb-8bf7edf0e7ae" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-quobyte-440b5978-286e-422b-bacb-8bf7edf0e7ae" acquired by "delete_volume" :: waited 0.039s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Creating offline snapshot 82e2b63e-2048-443f-882c-e1dc5cb3ad74 of volume f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33664b1f-b7ca-4835-a30c-5746e5d5d0fc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c36c138-e70c-4bf8-a6c1-2b2fcd0b6c62]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:03 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae Sep 09 14:42:03 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:03 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 Sep 09 14:42:03 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:03 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7" returned: 0 in 0.652s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:03 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae" returned: 0 in 0.714s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:03 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae Sep 09 14:42:03 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 1G Sep 09 14:42:03 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:03 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:04 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-440b5978-286e-422b-bacb-8bf7edf0e7ae" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-quobyte-440b5978-286e-422b-bacb-8bf7edf0e7ae" released by "delete_volume" :: held 1.272s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Created reservations ['54df352d-e995-4f8b-b079-86bf843bb239', '2a3fc24a-08d6-4a65-99fe-27d92e3e180c', '4687d877-c0aa-46d7-a71f-e97acac1780f', 'a7b98f5b-5ce8-4887-8d1f-9f3299111011'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:04 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 1G" returned: 0 in 0.979s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af6820-48c5-4171-b97a-1474265744d7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:04 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af6820-48c5-4171-b97a-1474265744d7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 Sep 09 14:42:04 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:05 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:05 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:05 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0af6820-48c5-4171-b97a-1474265744d7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74" returned: 0 in 0.601s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:05 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 is being set with open permissions: ugo+rw Sep 09 14:42:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:05 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 Sep 09 14:42:05 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:05 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.898s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:05 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Deleted volume successfully. Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-36dcc55c-a4a3-4a7e-b88e-80779ad1fca5 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-440b5978-286e-422b-bacb-8bf7edf0e7ae-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "cinder-f90ceb4f-5db2-4c65-8150-d2e63893a901-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-f90ceb4f-5db2-4c65-8150-d2e63893a901-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "cinder-quobyte-f90ceb4f-5db2-4c65-8150-d2e63893a901" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:06 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74" returned: 0 in 1.022s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-quobyte-f90ceb4f-5db2-4c65-8150-d2e63893a901" acquired by "delete_volume" :: waited 0.085s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cbdc35-b53d-48dc-b87c-da72eaf0e3ab]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:06 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info Sep 09 14:42:06 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:07 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 Sep 09 14:42:07 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:07 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info" returned: 0 in 0.702s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:07 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info is being set with open permissions: ugo+rw Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:07 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info Sep 09 14:42:07 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:07 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901" returned: 0 in 0.990s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:07 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901 Sep 09 14:42:07 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:07 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.info" returned: 0 in 0.472s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] snapshot: 82e2b63e-2048-443f-882c-e1dc5cb3ad74, volume: e51d927a-9bd1-4467-9f06-78faa0e5f4e0, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ccb9e7-074a-4a27-a081-3c5055f71d95]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:08 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f90ceb4f-5db2-4c65-8150-d2e63893a901" returned: 0 in 0.551s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:08 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 Sep 09 14:42:08 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-quobyte-f90ceb4f-5db2-4c65-8150-d2e63893a901" released by "delete_volume" :: held 1.670s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Created reservations ['f53d5971-e21f-4591-99e8-d6296600e05f', 'eb39b848-688a-4e7d-b112-4a24be072a01', 'de125a0c-1a8f-4012-a29b-8f04e4f35c42', '99f064b8-f42e-4199-bfaf-2777fe9fb385'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:08 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:08 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:08 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74" returned: 0 in 0.706s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0af6820-48c5-4171-b97a-1474265744d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d1f9d-b1fc-414c-b7f4-404dce3269f1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:08 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.492s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:08 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Deleted volume successfully. Sep 09 14:42:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a4b159e4-9c36-4e78-8260-9de997a788f4 tempest-AttachVolumeNegativeTest-1886537612 None] Lock "cinder-f90ceb4f-5db2-4c65-8150-d2e63893a901-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:09 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 Sep 09 14:42:09 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:09 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7" returned: 0 in 1.102s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:42:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:42:09 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:42:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:09 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 Sep 09 14:42:09 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Flow 'volume_create_manager' (fcd4259e-5c0e-4c35-81aa-580bd8412c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55992f1-fe5f-4635-9c4f-ed97f5f5e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55992f1-fe5f-4635-9c4f-ed97f5f5e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1065517991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f970e65-adaf-47d8-bf23-fcd4033c3b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749ca9eabad04ebd8578ed7b9ed051ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:17Z,use_quota=True,user_id='36c52edd13c44e13a5b47ea8437de850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90488c2b-d37c-457d-8954-52e6e33afa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90488c2b-d37c-457d-8954-52e6e33afa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b99858-947a-4e52-af57-075f1fc25f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b99858-947a-4e52-af57-075f1fc25f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f970e65-adaf-47d8-bf23-fcd4033c3b63', 'volume_name': 'volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18196183-16df-48a4-84c5-b1b16472f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18196183-16df-48a4-84c5-b1b16472f952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc14c81-9cab-4581-a5bf-bba8d8331218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:17 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Volume 6f970e65-adaf-47d8-bf23-fcd4033c3b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63', 'volume_size': 1} Sep 09 14:42:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" returned: 0 in 8.684s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:42:18 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Converted 1024.00 MB image at 117.90 MB/s Sep 09 14:42:18 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 is being set with open permissions: ugo+rw Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:18 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 Sep 09 14:42:18 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:18 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Flow 'volume_create_manager' (7d94d525-b543-47a9-8711-830c717e5e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a2c217-20b1-4b1c-9332-8603354119b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" released by "_copy_volume_from_snapshot" :: held 11.096s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a2c217-20b1-4b1c-9332-8603354119b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-147034343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a1d903-3357-4d91-a90b-0932bbd27a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c352c27e31b48eabf97763b67028139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:19Z,use_quota=True,user_id='66ada065e9804679a92e636b6aa91008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5241edce-52fd-476c-b49f-d09b74c3f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5241edce-52fd-476c-b49f-d09b74c3f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b965e56b-5536-4131-84f6-38d9df2617c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-82e2b63e-2048-443f-882c-e1dc5cb3ad74" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-82e2b63e-2048-443f-882c-e1dc5cb3ad74" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Deleting offline snapshot 82e2b63e-2048-443f-882c-e1dc5cb3ad74 of volume f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] snapshot_file for this snap is: volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d05bd7-9755-44f6-b4eb-4a905427b787]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:19 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 Sep 09 14:42:19 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b965e56b-5536-4131-84f6-38d9df2617c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8a1d903-3357-4d91-a90b-0932bbd27a91', 'volume_name': 'volume-a8a1d903-3357-4d91-a90b-0932bbd27a91', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e518fd-63b0-4132-963d-87d62fcf998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e518fd-63b0-4132-963d-87d62fcf998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768fc631-8fdc-47ef-9fa8-84d68578f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Volume a8a1d903-3357-4d91-a90b-0932bbd27a91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8a1d903-3357-4d91-a90b-0932bbd27a91', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Trying to clone a8a1d903-3357-4d91-a90b-0932bbd27a91 from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:42:19 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74" returned: 0 in 0.463s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0af6820-48c5-4171-b97a-1474265744d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[511b9a14-edec-426e-9e02-99d0f8da6c46]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:20 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 Sep 09 14:42:20 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:20 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:42:20 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Image download 20.69 MB at 20.69 MB/s Sep 09 14:42:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2947a1-6ae8-44ed-a743-18bf9277ef51]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:20 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD Sep 09 14:42:20 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:20 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD" returned: 0 in 0.652s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:21 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 is fetched for user 66ada065e9804679a92e636b6aa91008. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:42:21 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7" returned: 0 in 1.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:21 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 Sep 09 14:42:21 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:21 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa2879b-8777-456e-a888-7bc95df901fd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:21 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD Sep 09 14:42:21 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:22 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74" returned: 0 in 0.988s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:22 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74 Sep 09 14:42:22 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:22 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD" returned: 0 in 1.016s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:22 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7.82e2b63e-2048-443f-882c-e1dc5cb3ad74" returned: 0 in 0.665s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-82e2b63e-2048-443f-882c-e1dc5cb3ad74" released by "_delete_snapshot" :: held 3.768s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.881s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.463s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1065517991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f970e65-adaf-47d8-bf23-fcd4033c3b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749ca9eabad04ebd8578ed7b9ed051ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:17Z,use_quota=True,user_id='36c52edd13c44e13a5b47ea8437de850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Creating volume 6f970e65-adaf-47d8-bf23-fcd4033c3b63 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:42:22 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5757dc-4403-493d-8bf4-309167ab9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0', 'volume_size': 1, 'source_volid': 'f0af6820-48c5-4171-b97a-1474265744d7', 'source_volstatus': 'available'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:22 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 1073741824 Sep 09 14:42:22 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90f9d66-768f-4f09-ad23-78cef073ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Volume volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 (e51d927a-9bd1-4467-9f06-78faa0e5f4e0): created successfully Sep 09 14:42:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90f9d66-768f-4f09-ad23-78cef073ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (f3cb2bf7-98ea-4dea-8c0b-d15659a78465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-50544a86-472d-44cd-8f2e-7f136a536388 tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:42:23 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 1073741824" returned: 0 in 0.829s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:23 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 Sep 09 14:42:23 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:24 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-147034343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a1d903-3357-4d91-a90b-0932bbd27a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c352c27e31b48eabf97763b67028139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:19Z,use_quota=True,user_id='66ada065e9804679a92e636b6aa91008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Creating volume a8a1d903-3357-4d91-a90b-0932bbd27a91 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:42:24 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=100,cinder:INSERT=23,cinder:SELECT=84,cinder:DELETE=8 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:42:24 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 1073741824 Sep 09 14:42:24 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc14c81-9cab-4581-a5bf-bba8d8331218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2ce2ea-6c11-4cbb-81d8-5c14c3feb39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=94,cinder:UPDATE=99,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:42:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Volume volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 (6f970e65-adaf-47d8-bf23-fcd4033c3b63): created successfully Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2ce2ea-6c11-4cbb-81d8-5c14c3feb39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Flow 'volume_create_manager' (fcd4259e-5c0e-4c35-81aa-580bd8412c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1e3f5e42-936b-4d36-a80e-8c0f8c73da87 tempest-ServerRescueNegativeTestJSON-1437463862 None] Created volume successfully. Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (d4af13d9-5c89-4e43-9dbd-ccf285f032a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c57d5a-1771-4142-b93c-1bc2ad604bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c57d5a-1771-4142-b93c-1bc2ad604bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-825788215',display_name='tempest-VolumesGetTest-Volume-1815494867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d89993-24db-4e85-8fef-86a1ea8ef899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:25Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89093e5a-d6a7-4f05-b2e8-ac71db74170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89093e5a-d6a7-4f05-b2e8-ac71db74170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e16dae8-2726-42a4-93c3-1b49c6a78581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e16dae8-2726-42a4-93c3-1b49c6a78581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d89993-24db-4e85-8fef-86a1ea8ef899', 'volume_name': 'volume-22d89993-24db-4e85-8fef-86a1ea8ef899', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f220e25-6be9-44a4-b1a0-49033be830eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f220e25-6be9-44a4-b1a0-49033be830eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0141818-b575-43fa-8076-bbcdf6845411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Volume 22d89993-24db-4e85-8fef-86a1ea8ef899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d89993-24db-4e85-8fef-86a1ea8ef899', 'volume_size': 1} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:24 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 1073741824" returned: 0 in 0.593s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:24 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 Sep 09 14:42:24 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:25 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91" returned: 0 in 0.269s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-825788215',display_name='tempest-VolumesGetTest-Volume-1815494867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d89993-24db-4e85-8fef-86a1ea8ef899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:25Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Creating volume 22d89993-24db-4e85-8fef-86a1ea8ef899 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:42:25 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:25 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 1073741824 Sep 09 14:42:25 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Attempting download of 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume a8a1d903-3357-4d91-a90b-0932bbd27a91. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc9d8b-b6cd-4623-8ce2-ee66f2c90c93]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:25 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm Sep 09 14:42:25 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:25 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm" returned: 0 in 0.514s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:25 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 1073741824" returned: 0 in 0.633s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:25 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 Sep 09 14:42:25 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:25 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm Sep 09 14:42:25 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:26 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm" returned: 1 in 0.386s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_ayb3qprm' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db35ab2-0150-44e6-8474-742613feff33]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:26 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0141818-b575-43fa-8076-bbcdf6845411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d89993-24db-4e85-8fef-86a1ea8ef899', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68587934-da98-45cd-a4de-d47b9175de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Volume volume-22d89993-24db-4e85-8fef-86a1ea8ef899 (22d89993-24db-4e85-8fef-86a1ea8ef899): created successfully Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68587934-da98-45cd-a4de-d47b9175de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (d4af13d9-5c89-4e43-9dbd-ccf285f032a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-44437243-dec6-4b67-a194-7e3bf9741c7c tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:42:26 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD Sep 09 14:42:26 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:26 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] 0dcaa084-c738-4c9b-8211-0cc749ab59f6 was qcow2, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:42:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:26 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 Sep 09 14:42:26 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-22d89993-24db-4e85-8fef-86a1ea8ef899-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Lock "cinder-22d89993-24db-4e85-8fef-86a1ea8ef899-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-22d89993-24db-4e85-8fef-86a1ea8ef899" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-22d89993-24db-4e85-8fef-86a1ea8ef899" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bda4ca1-8157-4393-b0eb-ccf61364a9cd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:27 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 Sep 09 14:42:27 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-26b23937-a533-46c3-b7a4-217ad8ddc490 tempest-BackendsCapabilitiesAdminTestsJSON-416009103 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3789901733398, 'free_capacity_gb': 1773.3789901733398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87325) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-65485c45-080f-48fe-a9a0-559f9d5d5186 tempest-BackendsCapabilitiesAdminTestsJSON-416009103 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3789901733398, 'free_capacity_gb': 1773.3789901733398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87325) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 14:42:27 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899" returned: 0 in 0.614s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:27 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899 Sep 09 14:42:27 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:28 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22d89993-24db-4e85-8fef-86a1ea8ef899" returned: 0 in 0.288s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-22d89993-24db-4e85-8fef-86a1ea8ef899" released by "delete_volume" :: held 0.961s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Created reservations ['4348d295-079c-4efa-8670-d5260b97820e', 'e2d75048-94cc-447e-bfcc-18839569dd42', '01fc738f-dff7-4606-8630-d65c344e7ca8', '284313e4-07ac-482c-96cc-8dcbebc4dac8'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:28 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:28 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:28 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:42:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-536b0e06-1cc1-4ef3-a877-c70f57b1b329 tempest-VolumesGetTest-1543688942 None] Lock "cinder-22d89993-24db-4e85-8fef-86a1ea8ef899-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:29 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91" returned: 0 in 2.426s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_flmq6z45devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:42:29 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Converted 112.00 MB image at 46.15 MB/s Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:29 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 1G Sep 09 14:42:29 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:29 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 1G" returned: 0 in 0.412s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Downloaded image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume a8a1d903-3357-4d91-a90b-0932bbd27a91 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 for user 66ada065e9804679a92e636b6aa91008 is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Marking volume a8a1d903-3357-4d91-a90b-0932bbd27a91 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Copying metadata from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 to a8a1d903-3357-4d91-a90b-0932bbd27a91. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Creating volume glance metadata for volume a8a1d903-3357-4d91-a90b-0932bbd27a91 backed by image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768fc631-8fdc-47ef-9fa8-84d68578f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a1d903-3357-4d91-a90b-0932bbd27a91', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b76ffd-b7a9-416d-b214-d000e25c5df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:29 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Volume volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 (a8a1d903-3357-4d91-a90b-0932bbd27a91): created successfully Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b76ffd-b7a9-416d-b214-d000e25c5df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Flow 'volume_create_manager' (7d94d525-b543-47a9-8711-830c717e5e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-e51d927a-9bd1-4467-9f06-78faa0e5f4e0-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-24641981-dad4-4bc8-a751-ddba48007232 tempest-ServerActionsTestOtherA-1852752606 None] Created volume successfully. Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Lock "cinder-e51d927a-9bd1-4467-9f06-78faa0e5f4e0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c025aaa-ebc4-410c-bbed-d361210e6f31]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:30 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 Sep 09 14:42:30 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:30 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" returned: 0 in 0.625s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:30 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0 Sep 09 14:42:30 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:31 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" returned: 0 in 0.495s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-e51d927a-9bd1-4467-9f06-78faa0e5f4e0" released by "delete_volume" :: held 1.197s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Created reservations ['53a00e89-984a-44c7-a457-7a92c438279d', '4123975d-9967-41eb-8776-8ae52b6cf975', 'ddaff203-5fe3-49bb-8777-bd88e7f30d1e', 'dbc72721-05f1-42f3-a351-0f65932bf20a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:31 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:31 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:31 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.458s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:42:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d61ee38d-0a09-4090-a1ea-1569e6865040 tempest-VolumesGetTest-1543688942 None] Lock "cinder-e51d927a-9bd1-4467-9f06-78faa0e5f4e0-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-f0af6820-48c5-4171-b97a-1474265744d7-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Lock "cinder-f0af6820-48c5-4171-b97a-1474265744d7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-f0af6820-48c5-4171-b97a-1474265744d7" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-f0af6820-48c5-4171-b97a-1474265744d7" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ca3f11-24b3-4ca9-bc67-2e3ede639b8e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:32 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 Sep 09 14:42:32 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:33 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7" returned: 0 in 0.661s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:33 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7 Sep 09 14:42:33 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:33 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0af6820-48c5-4171-b97a-1474265744d7" returned: 0 in 0.421s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-f0af6820-48c5-4171-b97a-1474265744d7" released by "delete_volume" :: held 1.179s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:33 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Created reservations ['7531b30a-d954-44dd-81dd-2769fa578c4f', '6725117e-8440-4586-83fe-08afda3246a8', '61376faa-1b87-4650-8ce5-cc335acf31df', 'f45272e1-32c5-4c14-8118-a797c121cf11'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:34 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:34 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:34 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.447s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:42:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d2e6cc15-b3bd-403d-93ea-b4f7c7ba217d tempest-VolumesGetTest-1543688942 None] Lock "cinder-f0af6820-48c5-4171-b97a-1474265744d7-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-63b6e1f4-d940-415a-89ab-4d44d935e127 req-fce3b92a-3add-433e-a323-e40d89794990 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-63b6e1f4-d940-415a-89ab-4d44d935e127 req-fce3b92a-3add-433e-a323-e40d89794990 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-63b6e1f4-d940-415a-89ab-4d44d935e127 req-fce3b92a-3add-433e-a323-e40d89794990 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-63b6e1f4-d940-415a-89ab-4d44d935e127 req-fce3b92a-3add-433e-a323-e40d89794990 tempest-ServerActionsTestOtherA-1852752606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-a8a1d903-3357-4d91-a90b-0932bbd27a91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74e85b98-4a22-485e-a4f7-3792e3f3dc09', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:42:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-63b6e1f4-d940-415a-89ab-4d44d935e127 req-fce3b92a-3add-433e-a323-e40d89794990 tempest-ServerActionsTestOtherA-1852752606 None] attachment_update completed successfully. Sep 09 14:42:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Acquiring lock "cinder-6f970e65-adaf-47d8-bf23-fcd4033c3b63-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "cinder-6f970e65-adaf-47d8-bf23-fcd4033c3b63-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Acquiring lock "cinder-quobyte-6f970e65-adaf-47d8-bf23-fcd4033c3b63" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "cinder-quobyte-6f970e65-adaf-47d8-bf23-fcd4033c3b63" acquired by "delete_volume" :: waited 0.049s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b9bd7b-405a-4ce6-80d3-3c970b79921a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:37 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 Sep 09 14:42:37 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (6147f117-d8a7-4ef9-b073-9bd1507e3ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca11730b-6d2f-4b49-baef-1d2c61157759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca11730b-6d2f-4b49-baef-1d2c61157759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-75202426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552fb37-1182-4496-a98f-be6159b293eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:38Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0975d026-476c-448a-949a-5bd2ae7c373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0975d026-476c-448a-949a-5bd2ae7c373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6a3c0e-5169-4af9-bb73-3f8b035cca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:37 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:42:38 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63" returned: 0 in 0.758s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:38 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63 Sep 09 14:42:38 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6a3c0e-5169-4af9-bb73-3f8b035cca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a552fb37-1182-4496-a98f-be6159b293eb', 'volume_name': 'volume-a552fb37-1182-4496-a98f-be6159b293eb', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:38 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed64e26-d526-4344-bdd9-980ac9e44bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed64e26-d526-4344-bdd9-980ac9e44bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd869024-d0a6-4890-a681-018ffcceefa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Volume a552fb37-1182-4496-a98f-be6159b293eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a552fb37-1182-4496-a98f-be6159b293eb', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Trying to clone a552fb37-1182-4496-a98f-be6159b293eb from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6f970e65-adaf-47d8-bf23-fcd4033c3b63" returned: 0 in 0.381s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "cinder-quobyte-6f970e65-adaf-47d8-bf23-fcd4033c3b63" released by "delete_volume" :: held 1.246s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Created reservations ['a05d04bc-58a3-4675-bab1-952478ab3e2a', '7f41c53f-20f1-4dce-be43-8483d9eff9cc', '1a736908-ebc8-4cc2-af93-87743732c480', 'b6ed90ce-1f88-4ebd-802c-312082907f64'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-562469b3-938a-44a5-9f8c-8f0a529eb39d tempest-GroupSnapshotsV319Test-2032839523 None] Group tempest-GroupSnapshotsV319Test-Group-1439534834: creating Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:38 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:38 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-562469b3-938a-44a5-9f8c-8f0a529eb39d tempest-GroupSnapshotsV319Test-2032839523 None] Group tempest-GroupSnapshotsV319Test-Group-1439534834: created successfully Sep 09 14:42:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-562469b3-938a-44a5-9f8c-8f0a529eb39d tempest-GroupSnapshotsV319Test-2032839523 None] Create group completed successfully. Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:42:39 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Image download 20.69 MB at 20.69 MB/s Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372ffe1-e0fa-4284-8e68-173e10d83ff8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:39 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.466s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Deleted volume successfully. Sep 09 14:42:39 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD Sep 09 14:42:39 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a0ccc61c-bebd-4db2-afe6-49a1c574aacb tempest-ServerRescueNegativeTestJSON-1437463862 None] Lock "cinder-6f970e65-adaf-47d8-bf23-fcd4033c3b63-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:39 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 is fetched for user 6f070793ba6a4404943a56723dce0110. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e424a1-226d-43d3-8c73-769c5a079aa7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:40 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD Sep 09 14:42:40 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:40 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD" returned: 0 in 0.991s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-75202426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552fb37-1182-4496-a98f-be6159b293eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:38Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Creating volume a552fb37-1182-4496-a98f-be6159b293eb {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:42:41 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:41 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb 1073741824 Sep 09 14:42:41 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Flow 'volume_create_manager' (78919629-6e6d-4bfa-ba3c-7f0961866382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd7aa0-96a2-4781-bc11-17dfc61e5115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd7aa0-96a2-4781-bc11-17dfc61e5115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987853285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7ae5280-2021-4dcd-b4f1-566ac92dabdb,host='devstack@QuobyteHD#QuobyteHD',id=bec4d798-e8ef-4a3c-891e-1ba40c05ea68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27719ddc7d39420599c64d1aa6292d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:42Z,use_quota=True,user_id='6798d168d10b43238a76aedcf6222926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4548a6e-d063-4117-b905-c6e22efe9c2e),volume_type_id=b4548a6e-d063-4117-b905-c6e22efe9c2e)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9ac254-6d5a-48fe-a4d9-39b9aaedc7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9ac254-6d5a-48fe-a4d9-39b9aaedc7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23808449-7c2e-41bd-9668-4e01d7e4fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23808449-7c2e-41bd-9668-4e01d7e4fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec4d798-e8ef-4a3c-891e-1ba40c05ea68', 'volume_name': 'volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ef5b63-26ba-4c8e-8ebc-01e6e338cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ef5b63-26ba-4c8e-8ebc-01e6e338cd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8d6d3b-48c3-41d5-9e1c-ed171e21a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:41 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Volume bec4d798-e8ef-4a3c-891e-1ba40c05ea68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68', 'volume_size': 1} Sep 09 14:42:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:42 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb 1073741824" returned: 0 in 1.108s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:42 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb Sep 09 14:42:42 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:42 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb" returned: 0 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7ae5280-2021-4dcd-b4f1-566ac92dabdb,created_at=2026-09-09T12:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987853285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7ae5280-2021-4dcd-b4f1-566ac92dabdb,host='devstack@QuobyteHD#QuobyteHD',id=bec4d798-e8ef-4a3c-891e-1ba40c05ea68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27719ddc7d39420599c64d1aa6292d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:42Z,use_quota=True,user_id='6798d168d10b43238a76aedcf6222926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4548a6e-d063-4117-b905-c6e22efe9c2e),volume_type_id=b4548a6e-d063-4117-b905-c6e22efe9c2e)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Creating volume bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:42:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:42 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 1073741824 Sep 09 14:42:42 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Attempting download of 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume a552fb37-1182-4496-a98f-be6159b293eb. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040f1f1-86b1-4cf6-b6e9-e4c73c100db6]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:43 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl Sep 09 14:42:43 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:43 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl" returned: 0 in 0.826s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:43 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 1073741824" returned: 0 in 1.219s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:43 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 Sep 09 14:42:43 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:44 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl Sep 09 14:42:44 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:44 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" returned: 0 in 0.825s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8d6d3b-48c3-41d5-9e1c-ed171e21a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd05e57e-4bd9-4654-a923-d2bdb204aa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Volume volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 (bec4d798-e8ef-4a3c-891e-1ba40c05ea68): created successfully Sep 09 14:42:44 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd05e57e-4bd9-4654-a923-d2bdb204aa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Flow 'volume_create_manager' (78919629-6e6d-4bfa-ba3c-7f0961866382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl" returned: 1 in 1.174s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_7wokz5xl' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ac885e-eea6-4e99-b29e-bfdf15da915c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a23f62a0-d2b3-4808-913f-83e33f4a4e02 tempest-GroupSnapshotsV319Test-2032839523 None] Created volume successfully. Sep 09 14:42:45 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD Sep 09 14:42:45 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:45 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD" returned: 0 in 0.630s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:45 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] 0dcaa084-c738-4c9b-8211-0cc749ab59f6 was qcow2, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:42:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:45 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb Sep 09 14:42:45 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] GroupSnapshot 8c380284-a097-48ac-942b-d6e55960fc57: creating. Sep 09 14:42:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Group snapshot 8c380284-a097-48ac-942b-d6e55960fc57: creating. {{(pid=87325) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 14:42:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Creating offline snapshot a8288a5a-71d6-4ce2-bb16-68f355570327 of volume bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:42:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e97608-cf91-46b6-84b7-67eb849a31bf]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:47 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 Sep 09 14:42:47 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:47 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" returned: 0 in 0.845s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:47 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 1G Sep 09 14:42:47 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:48 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 1G" returned: 0 in 0.875s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:48 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 Sep 09 14:42:48 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:49 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb" returned: 0 in 3.548s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_hcpvlv4zdevstack@QuobyteHD, size 112.00 MB, duration 3.55 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:42:49 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Converted 112.00 MB image at 31.55 MB/s Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:49 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb 1G Sep 09 14:42:49 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:49 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327" returned: 0 in 0.822s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:49 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:49 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 Sep 09 14:42:49 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:49 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb 1G" returned: 0 in 0.648s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Downloaded image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume a552fb37-1182-4496-a98f-be6159b293eb successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 for user 6f070793ba6a4404943a56723dce0110 is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Marking volume a552fb37-1182-4496-a98f-be6159b293eb as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Copying metadata from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 to a552fb37-1182-4496-a98f-be6159b293eb. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Creating volume glance metadata for volume a552fb37-1182-4496-a98f-be6159b293eb backed by image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:42:49 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327" returned: 0 in 0.521s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd869024-d0a6-4890-a681-018ffcceefa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a552fb37-1182-4496-a98f-be6159b293eb', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:50 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info Sep 09 14:42:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727f8056-3dfc-4b56-bc9b-a91c74f081f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:50 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Volume volume-a552fb37-1182-4496-a98f-be6159b293eb (a552fb37-1182-4496-a98f-be6159b293eb): created successfully Sep 09 14:42:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727f8056-3dfc-4b56-bc9b-a91c74f081f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (6147f117-d8a7-4ef9-b073-9bd1507e3ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-35228795-1df8-42f4-a943-41972e43e37b tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:42:50 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info" returned: 0 in 0.610s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:50 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:42:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:50 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info Sep 09 14:42:50 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:51 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.info" returned: 0 in 0.586s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.479s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-53fce3ab-2168-411b-bb35-dc6c447d96ff tempest-GroupSnapshotsV319Test-2032839523 None] group_snapshot 8c380284-a097-48ac-942b-d6e55960fc57: created successfully Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (3f764d50-2c03-4946-add7-0ba23374a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6883d7-e9b0-4faa-9712-527c2e62db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6883d7-e9b0-4faa-9712-527c2e62db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-320738779',display_name='tempest-VolumesGetTest-Volume-108606831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d76fcf5-baad-4806-a740-e44e2c744dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:52Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e675a6bf-105f-472e-ba07-2da314c20619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e675a6bf-105f-472e-ba07-2da314c20619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b698308-a657-47c1-b460-7edc988fe5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b698308-a657-47c1-b460-7edc988fe5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d76fcf5-baad-4806-a740-e44e2c744dfc', 'volume_name': 'volume-4d76fcf5-baad-4806-a740-e44e2c744dfc', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7456753b-ee6e-47c9-9139-3a0329ce4557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7456753b-ee6e-47c9-9139-3a0329ce4557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e65ded-f3d4-4a86-ab7e-8b96b10a8ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Volume 4d76fcf5-baad-4806-a740-e44e2c744dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d76fcf5-baad-4806-a740-e44e2c744dfc', 'volume_size': 1} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:42:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-320738779',display_name='tempest-VolumesGetTest-Volume-108606831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d76fcf5-baad-4806-a740-e44e2c744dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ae852104b5431dace02164555a4f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:42:52Z,use_quota=True,user_id='6f070793ba6a4404943a56723dce0110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Creating volume 4d76fcf5-baad-4806-a740-e44e2c744dfc {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:42:51 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:42:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:51 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc 1073741824 Sep 09 14:42:51 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:52 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:52 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:52 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.573s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:42:52 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc 1073741824" returned: 0 in 0.957s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:53 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc Sep 09 14:42:53 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:53 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc" returned: 0 in 0.354s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] group_snapshot 8c380284-a097-48ac-942b-d6e55960fc57: deleting Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e65ded-f3d4-4a86-ab7e-8b96b10a8ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d76fcf5-baad-4806-a740-e44e2c744dfc', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e79091c-7673-4dac-a22a-45da6804f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] group_snapshot 8c380284-a097-48ac-942b-d6e55960fc57: deleting {{(pid=87325) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 14:42:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Volume volume-4d76fcf5-baad-4806-a740-e44e2c744dfc (4d76fcf5-baad-4806-a740-e44e2c744dfc): created successfully Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e79091c-7673-4dac-a22a-45da6804f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Flow 'volume_create_manager' (3f764d50-2c03-4946-add7-0ba23374a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:42:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5f7103d5-8373-465c-b5ee-f42a6ea1045d tempest-VolumesGetTest-1543688942 None] Created volume successfully. Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "cinder-quobyte-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "cinder-quobyte-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "cinder-quobyte-a8288a5a-71d6-4ce2-bb16-68f355570327" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "cinder-quobyte-a8288a5a-71d6-4ce2-bb16-68f355570327" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Deleting offline snapshot a8288a5a-71d6-4ce2-bb16-68f355570327 of volume bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] snapshot_file for this snap is: volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[32019fcc-1b47-4c24-bdd1-27367f78bbf6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:53 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 Sep 09 14:42:53 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:54 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327" returned: 0 in 0.710s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-4d76fcf5-baad-4806-a740-e44e2c744dfc-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9873a78a-9e04-443f-8b74-19b4ba5cfce4]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Lock "cinder-4d76fcf5-baad-4806-a740-e44e2c744dfc-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-4d76fcf5-baad-4806-a740-e44e2c744dfc" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:54 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 Sep 09 14:42:54 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-4d76fcf5-baad-4806-a740-e44e2c744dfc" acquired by "delete_volume" :: waited 0.035s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf405ca0-b087-4a0d-b364-3464b3947fbc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:55 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc Sep 09 14:42:55 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:55 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" returned: 0 in 0.724s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:55 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 Sep 09 14:42:55 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:55 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc" returned: 0 in 0.708s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:55 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc Sep 09 14:42:55 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:55 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327" returned: 0 in 0.668s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:55 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327 Sep 09 14:42:55 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:55 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4d76fcf5-baad-4806-a740-e44e2c744dfc" returned: 0 in 0.576s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-4d76fcf5-baad-4806-a740-e44e2c744dfc" released by "delete_volume" :: held 1.374s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Created reservations ['807903d0-d490-4ab7-9cdf-c3e7d528baac', 'f2fa9dc8-2b5e-44c1-81f6-3ed7fbbcf103', 'ca93d791-7290-410e-af14-432214ed2822', 'd3a147c2-214f-4828-a36c-55890fe0c447'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:56 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68.a8288a5a-71d6-4ce2-bb16-68f355570327" returned: 0 in 0.559s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:56 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:56 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "cinder-quobyte-a8288a5a-71d6-4ce2-bb16-68f355570327" released by "_delete_snapshot" :: held 2.855s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Lock "cinder-quobyte-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" released by "delete_snapshot" :: held 2.892s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:56 devstack cinder-volume[87325]: WARNING cinder.quota [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-956443476 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-956443476, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:42:56 devstack cinder-volume[87325]: WARNING cinder.quota [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-956443476 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-956443476, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] Created reservations ['9e002792-f900-44c6-8853-4bbb7482baea', '890eea41-df9e-4735-b1f1-84e53788f8e1', '96151aec-cc27-4b12-b916-03255f23a60f', '78803c43-8b70-4d2c-8562-4cbe0d81939e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-17d5bd54-06c2-498f-bbf8-75a0e1519a25 tempest-GroupSnapshotsV319Test-2032839523 None] group_snapshot 8c380284-a097-48ac-942b-d6e55960fc57: deleted successfully Sep 09 14:42:56 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.346s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-330a0d19-924e-489a-a9a7-e867a2eaadc5 tempest-VolumesGetTest-1543688942 None] Lock "cinder-4d76fcf5-baad-4806-a740-e44e2c744dfc-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-a552fb37-1182-4496-a98f-be6159b293eb-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Lock "cinder-a552fb37-1182-4496-a98f-be6159b293eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Acquiring lock "cinder-quobyte-a552fb37-1182-4496-a98f-be6159b293eb" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-a552fb37-1182-4496-a98f-be6159b293eb" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb07fb-bc19-497e-b5c1-d4f095c15d33]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:57 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb Sep 09 14:42:57 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "cinder-quobyte-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Lock "cinder-quobyte-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e537be7-9722-4a9e-887f-b3e7a6a8c665]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:57 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb" returned: 0 in 0.726s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:57 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb Sep 09 14:42:57 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:57 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 Sep 09 14:42:57 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:58 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a552fb37-1182-4496-a98f-be6159b293eb" returned: 0 in 0.514s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Lock "cinder-quobyte-a552fb37-1182-4496-a98f-be6159b293eb" released by "delete_volume" :: held 1.340s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:58 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-93335891-bbd8-4380-8b29-1adb87f3632f tempest-ServerActionsTestOtherA-1852752606 None] Terminate volume connection completed successfully. Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-93335891-bbd8-4380-8b29-1adb87f3632f tempest-ServerActionsTestOtherA-1852752606 None] Deleting attachment 74e85b98-4a22-485e-a4f7-3792e3f3dc09. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" returned: 0 in 0.745s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Created reservations ['ff1ae19a-3a02-41d1-b9fa-1769a94568a9', '46331e39-e81a-471e-afc4-fb530dd83a0f', 'd4947100-ae34-4fcf-a966-9504c8ca756f', 'f28ba847-0682-4b6e-ae68-54c8851d417a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:58 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68 Sep 09 14:42:58 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:58 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:58 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:58 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" returned: 0 in 0.333s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Lock "cinder-quobyte-bec4d798-e8ef-4a3c-891e-1ba40c05ea68" released by "delete_volume" :: held 1.182s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:58 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.344s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Created reservations ['4af79d4d-17d3-4f72-9a6c-d22a6573b580'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Deleted volume successfully. Sep 09 14:42:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7be65dad-b433-4a7a-9586-182061f7fca2 tempest-VolumesGetTest-1543688942 None] Lock "cinder-a552fb37-1182-4496-a98f-be6159b293eb-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:42:58 devstack cinder-volume[87325]: WARNING cinder.quota [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-956443476 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-956443476, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Created reservations ['718deed3-7b6c-4e04-8b32-a84ffe4225c6', '237d3f2a-c173-4188-b31b-936e4d8a9717', 'bcd4a93e-1b42-48ba-8634-b22cc983a8ed', 'c2e69eca-fcc8-4cf0-a919-48679fb7f8b6'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:42:59 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:42:59 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:42:59 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.296s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:42:59 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:42:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-855809a9-c7fd-4595-b257-8b06767994ce tempest-GroupSnapshotsV319Test-2032839523 None] Delete group completed successfully. Sep 09 14:43:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-215e26f4-655f-4671-b512-9247441ea23b tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-215e26f4-655f-4671-b512-9247441ea23b tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-215e26f4-655f-4671-b512-9247441ea23b tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-215e26f4-655f-4671-b512-9247441ea23b tempest-ServerActionsTestOtherA-1852752606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-a8a1d903-3357-4d91-a90b-0932bbd27a91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd479f3cb-008c-4198-ad43-b4a0f3d6d6a7', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:43:00 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-eb964ee2-78e2-427c-bc0e-bfb378d6be0f req-215e26f4-655f-4671-b512-9247441ea23b tempest-ServerActionsTestOtherA-1852752606 None] attachment_update completed successfully. Sep 09 14:43:10 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=84,cinder:DELETE=8,cinder:SELECT=86,cinder:INSERT=33 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:43:10 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=93,cinder:UPDATE=94,cinder:INSERT=31,cinder:DELETE=4 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (fe42e423-70c5-4731-a0bf-719b7bf18cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093ec42c-e3a0-4ab1-9b7e-4ceff6b35363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093ec42c-e3a0-4ab1-9b7e-4ceff6b35363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1069519712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f3865e-c1cc-4701-8e93-e3572b0b1da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:25Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8871a3-abc8-4714-b81d-e0a77e5a21ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8871a3-abc8-4714-b81d-e0a77e5a21ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffa5811-e562-446d-a31b-4d1583c617d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffa5811-e562-446d-a31b-4d1583c617d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f3865e-c1cc-4701-8e93-e3572b0b1da0', 'volume_name': 'volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba394cb-d0b7-407e-ba5a-7e95f3c7f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba394cb-d0b7-407e-ba5a-7e95f3c7f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc08a06-191d-4fe2-b07c-9674e5c87e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Volume 22f3865e-c1cc-4701-8e93-e3572b0b1da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0', 'volume_size': 1} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1069519712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f3865e-c1cc-4701-8e93-e3572b0b1da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:25Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Creating volume 22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:43:24 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:43:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:24 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 1073741824 Sep 09 14:43:24 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b9ccda8a-7b4b-4e6b-b599-fc2725516065 tempest-GroupsV320Test-2105608104 None] Group tempest-GroupsV320Test-Group-1525443303: creating Sep 09 14:43:25 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b9ccda8a-7b4b-4e6b-b599-fc2725516065 tempest-GroupsV320Test-2105608104 None] Group tempest-GroupsV320Test-Group-1525443303: created successfully Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 1073741824" returned: 0 in 0.579s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b9ccda8a-7b4b-4e6b-b599-fc2725516065 tempest-GroupsV320Test-2105608104 None] Create group completed successfully. Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:25 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 Sep 09 14:43:25 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:25 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0" returned: 0 in 0.282s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc08a06-191d-4fe2-b07c-9674e5c87e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02bb43d-7d29-4c80-864e-fa2f42679db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Volume volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 (22f3865e-c1cc-4701-8e93-e3572b0b1da0): created successfully Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02bb43d-7d29-4c80-864e-fa2f42679db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (fe42e423-70c5-4731-a0bf-719b7bf18cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-570e1a9f-8f50-4cee-884f-789e0cd65f47 tempest-VolumesSnapshotTestJSON-214720469 None] Created volume successfully. Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Created reservations ['86c348f1-f4cf-4cf4-8f0b-3cbe49e02dee'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:27 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:43:27 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:27 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:43:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1c8648c1-a1a3-40b8-8ebf-7bdcc4816ba7 tempest-GroupsV320Test-2105608104 None] Delete group completed successfully. Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Creating offline snapshot 126a4a3d-0b22-4755-9d77-5701b4c19fd6 of volume 22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3776841-7b8b-42d2-bb2b-1fcd86fab8f1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:27 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 Sep 09 14:43:27 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:28 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0" returned: 0 in 0.433s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:28 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 1G Sep 09 14:43:28 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:28 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 1G" returned: 0 in 0.525s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:28 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 Sep 09 14:43:28 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:29 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:29 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 is being set with open permissions: ugo+rw Sep 09 14:43:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:29 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 Sep 09 14:43:29 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:29 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6" returned: 0 in 0.319s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:29 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info Sep 09 14:43:29 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:30 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info" returned: 0 in 0.739s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:30 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info is being set with open permissions: ugo+rw Sep 09 14:43:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:30 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info Sep 09 14:43:30 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:30 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.info" returned: 0 in 0.603s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f2bbeba9-eafc-40b2-85b9-2cc18050f11f tempest-VolumesSnapshotTestJSON-214720469 None] Create snapshot completed successfully Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-126a4a3d-0b22-4755-9d77-5701b4c19fd6-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-126a4a3d-0b22-4755-9d77-5701b4c19fd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-22f3865e-c1cc-4701-8e93-e3572b0b1da0" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-22f3865e-c1cc-4701-8e93-e3572b0b1da0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-126a4a3d-0b22-4755-9d77-5701b4c19fd6" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-126a4a3d-0b22-4755-9d77-5701b4c19fd6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Deleting offline snapshot 126a4a3d-0b22-4755-9d77-5701b4c19fd6 of volume 22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] snapshot_file for this snap is: volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9d968-56ee-4d41-aa3f-7f34f97a6c03]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:33 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 Sep 09 14:43:33 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:33 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6" returned: 0 in 0.943s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:43:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b857e-e22e-49d2-a817-e7bb276dcc58]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:33 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 Sep 09 14:43:33 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:34 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0" returned: 0 in 0.493s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:34 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 Sep 09 14:43:34 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-277580a5-2f19-4859-927e-3f389c519c70 req-3d37d8a4-e1af-4555-86a6-097ec6f44b94 tempest-ServerActionsTestOtherA-1852752606 None] Terminate volume connection completed successfully. Sep 09 14:43:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-277580a5-2f19-4859-927e-3f389c519c70 req-3d37d8a4-e1af-4555-86a6-097ec6f44b94 tempest-ServerActionsTestOtherA-1852752606 None] Deleting attachment d479f3cb-008c-4198-ad43-b4a0f3d6d6a7. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:43:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "cinder-a8a1d903-3357-4d91-a90b-0932bbd27a91-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-a8a1d903-3357-4d91-a90b-0932bbd27a91-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "cinder-quobyte-a8a1d903-3357-4d91-a90b-0932bbd27a91" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-quobyte-a8a1d903-3357-4d91-a90b-0932bbd27a91" acquired by "delete_volume" :: waited 0.055s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:35 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6" returned: 0 in 0.817s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a16fe-1736-4847-97ac-80b81bf0616d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:35 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6 Sep 09 14:43:35 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:35 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 Sep 09 14:43:35 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:35 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0.126a4a3d-0b22-4755-9d77-5701b4c19fd6" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-126a4a3d-0b22-4755-9d77-5701b4c19fd6" released by "_delete_snapshot" :: held 2.953s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-22f3865e-c1cc-4701-8e93-e3572b0b1da0" released by "delete_snapshot" :: held 3.032s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['ff3a6fd4-72a2-429d-9cb2-aa6ab2130c73', '7fec6ee0-4112-4433-ab23-89f79a284056', 'c07ea416-45e5-4a13-814c-e153ea4ee78d', 'a3aab6ac-2dd0-4386-a3ed-055f4d35fa2e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Delete snapshot completed successfully. Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-acb3fc69-02b7-4172-a147-5e1e46abf3ab tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-126a4a3d-0b22-4755-9d77-5701b4c19fd6-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:36 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91" returned: 0 in 0.979s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:36 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91 Sep 09 14:43:36 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:36 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a8a1d903-3357-4d91-a90b-0932bbd27a91" returned: 0 in 0.391s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-quobyte-a8a1d903-3357-4d91-a90b-0932bbd27a91" released by "delete_volume" :: held 1.455s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG cinder.quota [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Created reservations ['faf45a9c-bef0-4dd6-a142-acd1ab7644de', 'bcdffa7a-af74-43bc-9e0f-87dde2afc495', '8d773afa-66a5-43de-974a-d2ff2dae6193', 'b9027491-37dc-47c4-ad85-eda22d3f68c1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:36 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:43:36 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:37 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.490s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG cinder.manager [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:43:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Deleted volume successfully. Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-277580a5-2f19-4859-927e-3f389c519c70 req-616eb617-6828-475d-b6d3-57322e0c25c8 tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-a8a1d903-3357-4d91-a90b-0932bbd27a91-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "cinder-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "cinder-quobyte-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-quobyte-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42" acquired by "delete_volume" :: waited 0.037s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefe7cc7-34a3-441f-9a09-9d94e126c7fb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:38 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 Sep 09 14:43:38 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (a2cd85f9-29f9-447b-a5b2-53ef35a7e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c51e688-e380-489c-8e25-172e9d92b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c51e688-e380-489c-8e25-172e9d92b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1708404405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9940e4-434f-48a7-a967-c338c3b2d42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:38Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee70671-f1c6-4fe3-8a17-c3f8b4a42a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee70671-f1c6-4fe3-8a17-c3f8b4a42a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a38938-c362-4103-a57c-63bbedb8a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a38938-c362-4103-a57c-63bbedb8a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9940e4-434f-48a7-a967-c338c3b2d42b', 'volume_name': 'volume-3d9940e4-434f-48a7-a967-c338c3b2d42b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb8edea-62b2-48f6-b13d-0f93fa7f5f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb8edea-62b2-48f6-b13d-0f93fa7f5f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ce096b-2d49-42ec-ac5d-d6d19b0c7fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Volume 3d9940e4-434f-48a7-a967-c338c3b2d42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9940e4-434f-48a7-a967-c338c3b2d42b', 'volume_size': 1} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1708404405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9940e4-434f-48a7-a967-c338c3b2d42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:38Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Creating volume 3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:43:38 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:38 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b 1073741824 Sep 09 14:43:38 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:38 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42" returned: 0 in 0.500s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:38 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42 Sep 09 14:43:38 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:38 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-quobyte-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42" released by "delete_volume" :: held 0.962s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:38 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Created reservations ['6c042304-b1cc-4adf-ba67-f0ad8aa1f600', '49876576-4ac8-459b-bfba-28a999fa528a', '108bc41a-2527-4afb-9519-94c9fd9c5c63', 'b4e102b7-5894-45f0-a5ca-412b85f81c02'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:39 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b 1073741824" returned: 0 in 0.720s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:39 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:43:39 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:39 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b Sep 09 14:43:39 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:39 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b" returned: 0 in 0.319s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ce096b-2d49-42ec-ac5d-d6d19b0c7fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9940e4-434f-48a7-a967-c338c3b2d42b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c61e21-eee4-41f8-a8d2-36c2c79ceb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:39 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Volume volume-3d9940e4-434f-48a7-a967-c338c3b2d42b (3d9940e4-434f-48a7-a967-c338c3b2d42b): created successfully Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c61e21-eee4-41f8-a8d2-36c2c79ceb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (a2cd85f9-29f9-447b-a5b2-53ef35a7e506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-943e10d0-0c3b-4d97-aeb3-e4e4ebc443d0 tempest-VolumesSnapshotTestJSON-214720469 None] Created volume successfully. Sep 09 14:43:39 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.478s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:43:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Deleted volume successfully. Sep 09 14:43:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5dabbece-1314-4b24-ad9e-3aed681017aa tempest-ServerActionsTestOtherA-1852752606 None] Lock "cinder-272c643e-ab5f-455a-b7f3-ae7cdcd7cb42-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Creating offline snapshot 16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b of volume 3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:43:40 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b39ea-1ba1-4ae7-a1e7-6f704ef751d0]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:41 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b Sep 09 14:43:41 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:41 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b" returned: 0 in 0.763s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:41 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b 1G Sep 09 14:43:41 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:42 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b 1G" returned: 0 in 0.735s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9940e4-434f-48a7-a967-c338c3b2d42b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:42 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9940e4-434f-48a7-a967-c338c3b2d42b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b Sep 09 14:43:42 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:42 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9940e4-434f-48a7-a967-c338c3b2d42b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" returned: 0 in 0.477s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:42 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b is being set with open permissions: ugo+rw Sep 09 14:43:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:42 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b Sep 09 14:43:42 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:43 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" returned: 0 in 0.402s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:43 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info Sep 09 14:43:43 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:43 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info" returned: 0 in 0.321s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:43 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info is being set with open permissions: ugo+rw Sep 09 14:43:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:43 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info Sep 09 14:43:43 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:43 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.info" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:43 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a3d3a877-9c70-4984-ae54-eb4cfc9b5ad5 tempest-VolumesSnapshotTestJSON-214720469 None] Create snapshot completed successfully Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (200c7008-2d42-4a35-87a6-2452a4fd3448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed19cd2b-a566-4b0c-95b4-b2218d3b67a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed19cd2b-a566-4b0c-95b4-b2218d3b67a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1244397651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dfdd20-15d1-42e2-95fc-655b9cf167c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:45Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c591133c-0771-4320-93c1-252df8b60816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c591133c-0771-4320-93c1-252df8b60816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e156ca9-6a09-482e-999f-c898d73d1da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e156ca9-6a09-482e-999f-c898d73d1da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35dfdd20-15d1-42e2-95fc-655b9cf167c7', 'volume_name': 'volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7', 'volume_size': 2, 'snapshot_id': '16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a37063c-0038-4c43-9e11-811a0ec9bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a37063c-0038-4c43-9e11-811a0ec9bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b926af-2885-4f86-adbf-f11f57b80e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:45 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Volume 35dfdd20-15d1-42e2-95fc-655b9cf167c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7', 'volume_size': 2, 'snapshot_id': '16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b'} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b-35dfdd20-15d1-42e2-95fc-655b9cf167c7" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b-35dfdd20-15d1-42e2-95fc-655b9cf167c7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Creating volume 35dfdd20-15d1-42e2-95fc-655b9cf167c7 from snapshot 16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-35dfdd20-15d1-42e2-95fc-655b9cf167c7" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-35dfdd20-15d1-42e2-95fc-655b9cf167c7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] snapshot: 16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b, volume: 35dfdd20-15d1-42e2-95fc-655b9cf167c7, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[286b919b-4de8-4ca4-86b0-c8f23a573e14]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:45 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b Sep 09 14:43:45 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:46 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d9940e4-434f-48a7-a967-c338c3b2d42b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[33990866-4f80-4aaa-9e26-efb74fbbc515]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:46 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b Sep 09 14:43:46 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:46 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:43:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:46 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 Sep 09 14:43:46 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:52 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:43:52 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:52 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7" returned: 0 in 5.777s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:43:52 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Converted 1024.00 MB image at 177.18 MB/s Sep 09 14:43:52 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 is being set with open permissions: ugo+rw Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:52 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 Sep 09 14:43:52 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:52 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.333s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:43:52 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-35dfdd20-15d1-42e2-95fc-655b9cf167c7" released by "_copy_volume_from_snapshot" :: held 7.080s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b-35dfdd20-15d1-42e2-95fc-655b9cf167c7" released by "_create_volume_from_snapshot" :: held 7.178s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.197s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b926af-2885-4f86-adbf-f11f57b80e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7', 'volume_size': 2, 'snapshot_id': '16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9400cb-29ee-4638-b387-eb258618a66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:52 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Volume volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 (35dfdd20-15d1-42e2-95fc-655b9cf167c7): created successfully Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9400cb-29ee-4638-b387-eb258618a66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (200c7008-2d42-4a35-87a6-2452a4fd3448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:52 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c89995fc-59fc-411d-9102-6d819cdf3aa4 tempest-VolumesSnapshotTestJSON-214720469 None] Created volume successfully. Sep 09 14:43:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-35dfdd20-15d1-42e2-95fc-655b9cf167c7-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-35dfdd20-15d1-42e2-95fc-655b9cf167c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-35dfdd20-15d1-42e2-95fc-655b9cf167c7" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-35dfdd20-15d1-42e2-95fc-655b9cf167c7" acquired by "delete_volume" :: waited 0.037s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[19470961-6bcc-4e99-8655-ab20abdecadf]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:53 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 Sep 09 14:43:53 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:54 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7" returned: 0 in 0.485s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:54 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7 Sep 09 14:43:54 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:54 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-35dfdd20-15d1-42e2-95fc-655b9cf167c7" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-35dfdd20-15d1-42e2-95fc-655b9cf167c7" released by "delete_volume" :: held 0.845s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['6b8c05fc-d49c-4964-98a7-78dfcc2530f6', '451ab4ea-4f5d-4b5e-bc7d-6504f49c204a', '6d985c13-f9f2-49bd-b496-f5761e0319ab', '34b3339e-be1c-40a1-9b15-8295b49707b4'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:54 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:43:54 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-3d9940e4-434f-48a7-a967-c338c3b2d42b" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-3d9940e4-434f-48a7-a967-c338c3b2d42b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Deleting offline snapshot 16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b of volume 3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] snapshot_file for this snap is: volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd1ee5-3d04-4e5b-82fc-69324f2749ba]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:55 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:43:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Deleted volume successfully. Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c4c20c65-20a5-4678-9ba4-f44696621b2b tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-35dfdd20-15d1-42e2-95fc-655b9cf167c7-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:55 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b Sep 09 14:43:55 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:55 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" returned: 0 in 0.422s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d9940e4-434f-48a7-a967-c338c3b2d42b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f845af2a-90c1-4657-9284-bf55d93351c6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:55 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b Sep 09 14:43:55 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:56 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b" returned: 0 in 0.647s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:56 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b Sep 09 14:43:56 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:56 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" returned: 0 in 0.362s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:56 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b Sep 09 14:43:56 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:56 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b.16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" returned: 0 in 0.263s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b" released by "_delete_snapshot" :: held 1.867s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-3d9940e4-434f-48a7-a967-c338c3b2d42b" released by "delete_snapshot" :: held 1.896s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['1be503bb-bbcc-42b9-83b6-790a767c36e9', 'c28b3200-1569-460c-8244-596a967f2b42', '3021df9f-6279-4d3c-ab9f-76ce9a9a642c', 'e53de468-8428-4e64-bfc9-4f6138dedc9d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Delete snapshot completed successfully. Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-721ead3b-f4fa-48dc-9ace-f6f8d3054a3a tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-16f4ae48-c8b7-4783-9ba4-27f6f97d2e1b-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-3d9940e4-434f-48a7-a967-c338c3b2d42b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-3d9940e4-434f-48a7-a967-c338c3b2d42b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-3d9940e4-434f-48a7-a967-c338c3b2d42b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-3d9940e4-434f-48a7-a967-c338c3b2d42b" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[857a657e-6a65-41be-bcc9-d0a1fb302fdc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:57 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b Sep 09 14:43:57 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:57 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b" returned: 0 in 0.453s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:57 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b Sep 09 14:43:57 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:58 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3d9940e4-434f-48a7-a967-c338c3b2d42b" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-3d9940e4-434f-48a7-a967-c338c3b2d42b" released by "delete_volume" :: held 0.929s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['d46ddf4b-5561-4fa7-8f11-904aaee089b1', 'c0afdd14-c2d1-417f-90b9-ad5d4059f172', 'b8c03e8e-d79a-4b83-b37e-06f33d764df1', '4e331c80-c13c-4c8a-a44b-54b841f02d35'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:58 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:43:58 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Flow 'volume_create_manager' (c919267d-135f-4e24-a667-da3b0a6ad058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4862271c-331b-448e-b98e-63cb37e87c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4862271c-331b-448e-b98e-63cb37e87c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1652745882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d701183d-530f-4a05-82ab-0d1301b0a415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae0c5fb464945d9a2cd85c7654f2143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:59Z,use_quota=True,user_id='a2d522e76b1349be8562fc0a2458efd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc113dde-a597-4a38-80e0-885b49c7c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc113dde-a597-4a38-80e0-885b49c7c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fae327-88b4-4456-a343-9dd8909859e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fae327-88b4-4456-a343-9dd8909859e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd701183d-530f-4a05-82ab-0d1301b0a415', 'volume_name': 'volume-d701183d-530f-4a05-82ab-0d1301b0a415', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e9aa4-007e-4467-bd96-daf0a30655c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e9aa4-007e-4467-bd96-daf0a30655c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ff2d72-13a7-4bf4-8665-a0ef9d540354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:58 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Volume d701183d-530f-4a05-82ab-0d1301b0a415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d701183d-530f-4a05-82ab-0d1301b0a415', 'volume_size': 1} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1652745882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d701183d-530f-4a05-82ab-0d1301b0a415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae0c5fb464945d9a2cd85c7654f2143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:43:59Z,use_quota=True,user_id='a2d522e76b1349be8562fc0a2458efd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Creating volume d701183d-530f-4a05-82ab-0d1301b0a415 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:43:58 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:58 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 1073741824 Sep 09 14:43:58 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:58 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:43:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Deleted volume successfully. Sep 09 14:43:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cd74072-8b9b-47ec-b72a-2e0bdcc3e7f0 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-3d9940e4-434f-48a7-a967-c338c3b2d42b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:43:59 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 1073741824" returned: 0 in 0.533s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:43:59 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 Sep 09 14:43:59 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:43:59 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415" returned: 0 in 0.282s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ff2d72-13a7-4bf4-8665-a0ef9d540354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d701183d-530f-4a05-82ab-0d1301b0a415', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3315624-89b7-4ebd-a923-81c2e3d3a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:43:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Volume volume-d701183d-530f-4a05-82ab-0d1301b0a415 (d701183d-530f-4a05-82ab-0d1301b0a415): created successfully Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3315624-89b7-4ebd-a923-81c2e3d3a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:43:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Flow 'volume_create_manager' (c919267d-135f-4e24-a667-da3b0a6ad058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:43:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9d4bdfe6-da49-40a2-a729-ce4fbb33ea8d tempest-AttachVolumeTestJSON-1925831657 None] Created volume successfully. Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (84ddfaf6-3579-4861-99c2-23aa022b169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498fdec4-4df7-4d03-96e2-09ba381ffc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498fdec4-4df7-4d03-96e2-09ba381ffc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-815463350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaa20b7-477a-4bd2-a3fc-85767089acbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:00Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24820c11-e814-462b-8e78-b3e8dadb89bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24820c11-e814-462b-8e78-b3e8dadb89bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a011a75-9247-4b47-bae5-503d60aedeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a011a75-9247-4b47-bae5-503d60aedeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdaa20b7-477a-4bd2-a3fc-85767089acbe', 'volume_name': 'volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3442a399-84d1-4d2b-9567-e55dd46f2c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3442a399-84d1-4d2b-9567-e55dd46f2c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7156524e-66f8-4bdd-8a45-db8fba538f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Volume bdaa20b7-477a-4bd2-a3fc-85767089acbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe', 'volume_size': 1} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-815463350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaa20b7-477a-4bd2-a3fc-85767089acbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:00Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Creating volume bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:00 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:00 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe 1073741824 Sep 09 14:44:00 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:01 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe 1073741824" returned: 0 in 0.674s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:01 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe Sep 09 14:44:01 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:01 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe" returned: 0 in 0.375s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7156524e-66f8-4bdd-8a45-db8fba538f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44c7180-8bdc-46f6-87d8-f20705c2c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:01 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Volume volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe (bdaa20b7-477a-4bd2-a3fc-85767089acbe): created successfully Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44c7180-8bdc-46f6-87d8-f20705c2c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (84ddfaf6-3579-4861-99c2-23aa022b169c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-1387ed69-2ef3-47c6-80e2-8f603ad43d7e req-19eb202c-873c-47cd-9658-249854e01a2a tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-1387ed69-2ef3-47c6-80e2-8f603ad43d7e req-19eb202c-873c-47cd-9658-249854e01a2a tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-1387ed69-2ef3-47c6-80e2-8f603ad43d7e req-19eb202c-873c-47cd-9658-249854e01a2a tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6f5e9600-72f1-4dd2-8936-734989204219 tempest-VolumesSnapshotTestJSON-214720469 None] Created volume successfully. Sep 09 14:44:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-1387ed69-2ef3-47c6-80e2-8f603ad43d7e req-19eb202c-873c-47cd-9658-249854e01a2a tempest-AttachVolumeTestJSON-1925831657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-d701183d-530f-4a05-82ab-0d1301b0a415', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a6f4432-3b0c-4396-9fd4-2fa29d0f10fa', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:44:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-1387ed69-2ef3-47c6-80e2-8f603ad43d7e req-19eb202c-873c-47cd-9658-249854e01a2a tempest-AttachVolumeTestJSON-1925831657 None] attachment_update completed successfully. Sep 09 14:44:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Creating offline snapshot dea796f6-8d23-4758-a93c-b5421c28e827 of volume bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[579bd885-1f0d-4fde-b852-948638110802]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Flow 'volume_create_manager' (91fd130e-d428-401c-90bc-79195974b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21947898-9da7-476d-bb36-9d81410e70de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21947898-9da7-476d-bb36-9d81410e70de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-620979581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdb5502-639c-477e-9ccb-c7c5b2231633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6d91eb69d14ac3b331a578483cdbcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:03Z,use_quota=True,user_id='9cfc4c7883ec4709be7676cfd8aac782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2764aa01-ab08-42a1-bdfc-173b91b9f65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2764aa01-ab08-42a1-bdfc-173b91b9f65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd45fe39-56c7-4092-8072-b2c721a4afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd45fe39-56c7-4092-8072-b2c721a4afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdb5502-639c-477e-9ccb-c7c5b2231633', 'volume_name': 'volume-dfdb5502-639c-477e-9ccb-c7c5b2231633', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:03 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe Sep 09 14:44:03 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276ec875-2d42-4904-abff-7c299c8108e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276ec875-2d42-4904-abff-7c299c8108e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30661965-49e2-4cb3-8a77-b39759eb5182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:03 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Volume dfdb5502-639c-477e-9ccb-c7c5b2231633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdb5502-639c-477e-9ccb-c7c5b2231633', 'volume_size': 1} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:03 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:03 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 1G Sep 09 14:44:03 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:04 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 1G" returned: 0 in 0.602s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:04 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 Sep 09 14:44:04 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:04 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:04 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 is being set with open permissions: ugo+rw Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:04 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 Sep 09 14:44:04 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:04 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827" returned: 0 in 0.247s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:04 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info Sep 09 14:44:04 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:04 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:04 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info is being set with open permissions: ugo+rw Sep 09 14:44:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:04 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info Sep 09 14:44:04 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:05 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.info" returned: 0 in 0.282s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-620979581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdb5502-639c-477e-9ccb-c7c5b2231633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6d91eb69d14ac3b331a578483cdbcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:03Z,use_quota=True,user_id='9cfc4c7883ec4709be7676cfd8aac782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Creating volume dfdb5502-639c-477e-9ccb-c7c5b2231633 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:05 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:05 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 1073741824 Sep 09 14:44:05 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-73b9a95e-5f3a-4761-b32a-f6d1a9b2c295 tempest-VolumesSnapshotTestJSON-214720469 None] Create snapshot completed successfully Sep 09 14:44:05 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 1073741824" returned: 0 in 0.611s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:05 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 Sep 09 14:44:05 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:06 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633" returned: 0 in 0.320s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30661965-49e2-4cb3-8a77-b39759eb5182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdb5502-639c-477e-9ccb-c7c5b2231633', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d4b571-a375-471d-b3f3-0c8b74056e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:06 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Volume volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 (dfdb5502-639c-477e-9ccb-c7c5b2231633): created successfully Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d4b571-a375-471d-b3f3-0c8b74056e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Flow 'volume_create_manager' (91fd130e-d428-401c-90bc-79195974b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e857ff4b-be80-464e-8e3a-183b39298d9d tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Created volume successfully. Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (46889ec0-6241-435d-b4f6-fcf094241499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b306be-e25c-42de-b7ba-e04a2a43aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b306be-e25c-42de-b7ba-e04a2a43aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1821204871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af392ce-6f2f-4c82-8fff-039874bf6c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e45d6d91f64435a19bf237478b250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dea796f6-8d23-4758-a93c-b5421c28e827,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:07Z,use_quota=True,user_id='5c1f8b10e30848fdaa677e1a026c84fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbfeb56-078d-4482-a66f-fffaa29916d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbfeb56-078d-4482-a66f-fffaa29916d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136ab95-7ed6-4c92-86ec-e880740d768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136ab95-7ed6-4c92-86ec-e880740d768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6af392ce-6f2f-4c82-8fff-039874bf6c5b', 'volume_name': 'volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b', 'volume_size': 1, 'snapshot_id': 'dea796f6-8d23-4758-a93c-b5421c28e827'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f90a79-9da8-416f-bb60-260e2fcac088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f90a79-9da8-416f-bb60-260e2fcac088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e573b8-c1de-43f4-90e5-88cbcd3297fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:06 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Volume 6af392ce-6f2f-4c82-8fff-039874bf6c5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b', 'volume_size': 1, 'snapshot_id': 'dea796f6-8d23-4758-a93c-b5421c28e827'} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-dea796f6-8d23-4758-a93c-b5421c28e827-6af392ce-6f2f-4c82-8fff-039874bf6c5b" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-dea796f6-8d23-4758-a93c-b5421c28e827-6af392ce-6f2f-4c82-8fff-039874bf6c5b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Creating volume 6af392ce-6f2f-4c82-8fff-039874bf6c5b from snapshot dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-6af392ce-6f2f-4c82-8fff-039874bf6c5b" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-6af392ce-6f2f-4c82-8fff-039874bf6c5b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] snapshot: dea796f6-8d23-4758-a93c-b5421c28e827, volume: 6af392ce-6f2f-4c82-8fff-039874bf6c5b, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c1dcb-4a44-47d5-9330-30c9edab203e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:07 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 Sep 09 14:44:07 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:07 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827" returned: 0 in 0.599s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1bf070-8748-4afa-997d-2ef0f6915245]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:07 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe Sep 09 14:44:07 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:08 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe" returned: 0 in 0.608s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:44:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:44:08 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:44:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:08 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b Sep 09 14:44:08 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Acquiring lock "cinder-dfdb5502-639c-477e-9ccb-c7c5b2231633-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "cinder-dfdb5502-639c-477e-9ccb-c7c5b2231633-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Acquiring lock "cinder-quobyte-dfdb5502-639c-477e-9ccb-c7c5b2231633" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "cinder-quobyte-dfdb5502-639c-477e-9ccb-c7c5b2231633" acquired by "delete_volume" :: waited 0.060s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4ee682-afb7-4b4f-9485-c345c368a466]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:09 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 Sep 09 14:44:09 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:11 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633" returned: 0 in 1.475s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:11 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633 Sep 09 14:44:11 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:12 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dfdb5502-639c-477e-9ccb-c7c5b2231633" returned: 0 in 0.869s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "cinder-quobyte-dfdb5502-639c-477e-9ccb-c7c5b2231633" released by "delete_volume" :: held 2.492s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Created reservations ['77cf907a-cbfd-45b2-8b6a-77412b199540', '9012ce00-79c6-4266-8757-495641463080', '042fadc5-4560-44fa-846e-cc6182b41f21', '447b8006-0657-4e85-84b1-bb7c52884095'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:12 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:12 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:13 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.729s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:13 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Deleted volume successfully. Sep 09 14:44:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4b4ecde2-948d-4417-a4de-8442aa96b58f tempest-VolumeQuotasNegativeTestJSON-2101447073 None] Lock "cinder-dfdb5502-639c-477e-9ccb-c7c5b2231633-delete_volume" released by "delete_volume" :: held 3.994s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:16 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b" returned: 0 in 8.568s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:16 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:44:16 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Converted 1024.00 MB image at 119.50 MB/s Sep 09 14:44:16 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b is being set with open permissions: ugo+rw Sep 09 14:44:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:16 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b Sep 09 14:44:16 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:17 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b" returned: 0 in 0.313s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-6af392ce-6f2f-4c82-8fff-039874bf6c5b" released by "_copy_volume_from_snapshot" :: held 10.226s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-dea796f6-8d23-4758-a93c-b5421c28e827-6af392ce-6f2f-4c82-8fff-039874bf6c5b" released by "_create_volume_from_snapshot" :: held 10.322s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.346s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e573b8-c1de-43f4-90e5-88cbcd3297fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b', 'volume_size': 1, 'snapshot_id': 'dea796f6-8d23-4758-a93c-b5421c28e827'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d193f38-c55e-4d88-8eff-cac66c0fc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:17 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Volume volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b (6af392ce-6f2f-4c82-8fff-039874bf6c5b): created successfully Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d193f38-c55e-4d88-8eff-cac66c0fc646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Flow 'volume_create_manager' (46889ec0-6241-435d-b4f6-fcf094241499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1d17f841-5d81-420c-aec4-0025003e24d9 tempest-VolumesSnapshotTestJSON-214720469 None] Created volume successfully. Sep 09 14:44:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-6af392ce-6f2f-4c82-8fff-039874bf6c5b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-6af392ce-6f2f-4c82-8fff-039874bf6c5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-6af392ce-6f2f-4c82-8fff-039874bf6c5b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-6af392ce-6f2f-4c82-8fff-039874bf6c5b" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:18 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5b7819-f317-4f1f-bbd6-11f7d3b06da0]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:18 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b Sep 09 14:44:18 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:19 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b" returned: 0 in 0.652s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:19 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b Sep 09 14:44:19 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:19 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6af392ce-6f2f-4c82-8fff-039874bf6c5b" returned: 0 in 0.324s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-6af392ce-6f2f-4c82-8fff-039874bf6c5b" released by "delete_volume" :: held 1.061s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['1f930d1b-4892-4fe2-a512-f513d69e59c2', '388903e0-e0ce-4f0d-9989-cfbf9e48b140', 'b1298ca1-ea35-4546-9fd1-054ebc6c7c06', '0e91d24e-9f0a-44ef-939a-450656ff932a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:19 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:19 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:20 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.336s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:20 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Deleted volume successfully. Sep 09 14:44:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18b1b383-22b2-4ffc-80bd-a90234a5f631 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-6af392ce-6f2f-4c82-8fff-039874bf6c5b-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-dea796f6-8d23-4758-a93c-b5421c28e827-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-dea796f6-8d23-4758-a93c-b5421c28e827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-bdaa20b7-477a-4bd2-a3fc-85767089acbe" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-bdaa20b7-477a-4bd2-a3fc-85767089acbe" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-dea796f6-8d23-4758-a93c-b5421c28e827" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-dea796f6-8d23-4758-a93c-b5421c28e827" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Deleting offline snapshot dea796f6-8d23-4758-a93c-b5421c28e827 of volume bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] snapshot_file for this snap is: volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cad3a06-5e9c-48cc-b6ca-1fd20abd4e0b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:21 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 Sep 09 14:44:21 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:21 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827" returned: 0 in 0.586s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[68588756-ad5d-4aa6-bb79-0bc087a1aefe]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:22 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe Sep 09 14:44:22 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:23 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe" returned: 0 in 1.432s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:23 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 Sep 09 14:44:23 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:24 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827" returned: 0 in 0.802s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:24 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827 Sep 09 14:44:24 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:24 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe.dea796f6-8d23-4758-a93c-b5421c28e827" returned: 0 in 0.688s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=88,cinder:SELECT=93,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=87,cinder:UPDATE=93,cinder:INSERT=21,cinder:DELETE=10 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-dea796f6-8d23-4758-a93c-b5421c28e827" released by "_delete_snapshot" :: held 3.771s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-bdaa20b7-477a-4bd2-a3fc-85767089acbe" released by "delete_snapshot" :: held 3.817s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['b594cd28-07c0-4055-8c94-b7a0484c890e', 'f4f3cf40-6733-4c39-b052-6cc3797d5918', '49cf8ccd-509b-432d-96e8-234725993356', '02e42ae5-8e55-42e3-b75a-30d58c2166a1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Delete snapshot completed successfully. Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cdc1b833-86d0-42e2-93d3-379a2bdf96e2 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-dea796f6-8d23-4758-a93c-b5421c28e827-delete_snapshot" released by "delete_snapshot" :: held 4.132s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-bdaa20b7-477a-4bd2-a3fc-85767089acbe-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-bdaa20b7-477a-4bd2-a3fc-85767089acbe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-bdaa20b7-477a-4bd2-a3fc-85767089acbe" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-bdaa20b7-477a-4bd2-a3fc-85767089acbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41aabf9-413f-4f7c-baf1-aa245f938b39]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:25 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe Sep 09 14:44:25 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:26 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe" returned: 0 in 0.454s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:26 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe Sep 09 14:44:26 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:26 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bdaa20b7-477a-4bd2-a3fc-85767089acbe" returned: 0 in 0.493s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Flow 'volume_create_manager' (d8431f4c-a41c-4759-8c38-1de051ba1aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e8309b-fea6-436f-9c2d-e8267f8c81c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-bdaa20b7-477a-4bd2-a3fc-85767089acbe" released by "delete_volume" :: held 1.084s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e8309b-fea6-436f-9c2d-e8267f8c81c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-709727009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fa1924-da8d-4c8c-bf7b-020c1b06aa42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbb3c715e094d438cd000d3f0286ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:27Z,use_quota=True,user_id='2d5b238705f0401f855b1b0f44a7bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d71b70-ffeb-4db3-b7c1-615ba8f9d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d71b70-ffeb-4db3-b7c1-615ba8f9d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ae2b3-3db2-48f3-a330-d7bda543099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ae2b3-3db2-48f3-a330-d7bda543099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fa1924-da8d-4c8c-bf7b-020c1b06aa42', 'volume_name': 'volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594c2e3f-2f4f-4dda-a004-7398be6e96b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594c2e3f-2f4f-4dda-a004-7398be6e96b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6838031-0367-4ff7-9edc-1e54751148c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Volume 87fa1924-da8d-4c8c-bf7b-020c1b06aa42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42', 'volume_size': 1} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-709727009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fa1924-da8d-4c8c-bf7b-020c1b06aa42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbb3c715e094d438cd000d3f0286ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:27Z,use_quota=True,user_id='2d5b238705f0401f855b1b0f44a7bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Creating volume 87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:26 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:26 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 1073741824 Sep 09 14:44:26 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['ab4d471e-1c33-4edb-be72-066dbc6b003c', '7153158a-7b2c-4e83-aafc-2e9bce5906d9', '6730a68b-9196-4ba6-95a8-ccca5a55d744', 'e393a259-8eec-4c92-b724-02bcbe29e2f3'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:27 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:27 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:27 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.321s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Deleted volume successfully. Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ffed5df5-2901-44ed-9ad3-769eeb973cc4 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-bdaa20b7-477a-4bd2-a3fc-85767089acbe-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:27 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 1073741824" returned: 0 in 0.730s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:27 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 Sep 09 14:44:27 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:27 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" returned: 0 in 0.301s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6838031-0367-4ff7-9edc-1e54751148c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c52f0d0-e05b-44d1-ab87-ab968c0ed1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Volume volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 (87fa1924-da8d-4c8c-bf7b-020c1b06aa42): created successfully Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c52f0d0-e05b-44d1-ab87-ab968c0ed1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Flow 'volume_create_manager' (d8431f4c-a41c-4759-8c38-1de051ba1aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6210caee-0a51-4f43-8daa-3c3c3a83340a tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Created volume successfully. Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-22f3865e-c1cc-4701-8e93-e3572b0b1da0-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-22f3865e-c1cc-4701-8e93-e3572b0b1da0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "cinder-quobyte-22f3865e-c1cc-4701-8e93-e3572b0b1da0" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-22f3865e-c1cc-4701-8e93-e3572b0b1da0" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c244c-7961-42da-8b9b-13e67f697cb9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:28 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 Sep 09 14:44:28 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:28 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0" returned: 0 in 0.456s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:28 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0 Sep 09 14:44:28 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:28 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-22f3865e-c1cc-4701-8e93-e3572b0b1da0" returned: 0 in 0.367s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-quobyte-22f3865e-c1cc-4701-8e93-e3572b0b1da0" released by "delete_volume" :: held 0.931s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Creating offline snapshot 48297f7e-01d4-4393-92fe-8d7cc3d33c54 of volume 87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Created reservations ['ed7ef5f6-e875-4694-baeb-eb87d71e5eb1', '93d55cfd-7ff4-4b36-9c65-534a43becbc7', 'af94dd2e-da7b-4f17-97b0-5ca7e9099452', 'dd6b12c7-3a64-42a4-9e16-7f6fad389c8c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aef060-b0de-4c23-9ee1-886c93090aa7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:29 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:29 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:29 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 Sep 09 14:44:29 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:29 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.559s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Deleted volume successfully. Sep 09 14:44:29 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" returned: 0 in 0.727s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-921b99a0-56b1-41e4-bd6e-e8f6660d86e1 tempest-VolumesSnapshotTestJSON-214720469 None] Lock "cinder-22f3865e-c1cc-4701-8e93-e3572b0b1da0-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:30 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 1G Sep 09 14:44:30 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:30 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 1G" returned: 0 in 0.672s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:30 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 Sep 09 14:44:30 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:30 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54" returned: 0 in 0.335s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:30 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 is being set with open permissions: ugo+rw Sep 09 14:44:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:30 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 Sep 09 14:44:30 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:31 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:31 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info Sep 09 14:44:31 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:31 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info" returned: 0 in 0.475s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:31 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info is being set with open permissions: ugo+rw Sep 09 14:44:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:31 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info Sep 09 14:44:31 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:32 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.info" returned: 0 in 0.493s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6b7ead87-a142-4151-9da9-bba582ca860e tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Create snapshot completed successfully Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "cinder-48297f7e-01d4-4393-92fe-8d7cc3d33c54-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-48297f7e-01d4-4393-92fe-8d7cc3d33c54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "cinder-quobyte-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-quobyte-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "cinder-quobyte-48297f7e-01d4-4393-92fe-8d7cc3d33c54" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-quobyte-48297f7e-01d4-4393-92fe-8d7cc3d33c54" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Deleting offline snapshot 48297f7e-01d4-4393-92fe-8d7cc3d33c54 of volume 87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] snapshot_file for this snap is: volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509c383-b2d0-4fc4-b092-1051c727139f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:34 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 Sep 09 14:44:34 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:35 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54" returned: 0 in 0.563s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:44:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593a06e-ade7-4bef-b984-8294eac03ed6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:35 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 Sep 09 14:44:35 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:36 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" returned: 0 in 1.074s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:36 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 Sep 09 14:44:36 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-c80b5afc-4b64-4c58-b5dd-a9a035bbbb84 req-d0334963-5fcc-4a77-a42d-ff6388556781 tempest-AttachVolumeTestJSON-1925831657 None] Terminate volume connection completed successfully. Sep 09 14:44:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-c80b5afc-4b64-4c58-b5dd-a9a035bbbb84 req-d0334963-5fcc-4a77-a42d-ff6388556781 tempest-AttachVolumeTestJSON-1925831657 None] Deleting attachment 5a6f4432-3b0c-4396-9fd4-2fa29d0f10fa. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:44:37 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54" returned: 0 in 0.795s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:37 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54 Sep 09 14:44:37 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:38 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42.48297f7e-01d4-4393-92fe-8d7cc3d33c54" returned: 0 in 0.882s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-quobyte-48297f7e-01d4-4393-92fe-8d7cc3d33c54" released by "_delete_snapshot" :: held 3.582s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-quobyte-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" released by "delete_snapshot" :: held 3.637s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:38 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Created reservations ['f6bf4402-94bb-413d-8961-035bde6106dd', 'f7a782dd-00f7-43da-a5bd-5da0f54d612d', 'd727de67-23cc-4326-9e61-6ba3f1a3da14', 'e9c13a2e-fc5a-424e-8bd1-a84dd69722e4'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Delete snapshot completed successfully. Sep 09 14:44:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-68780e46-ebe9-4a1c-b7e4-9796c4f902ce tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-48297f7e-01d4-4393-92fe-8d7cc3d33c54-delete_snapshot" released by "delete_snapshot" :: held 3.987s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "cinder-87fa1924-da8d-4c8c-bf7b-020c1b06aa42-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-87fa1924-da8d-4c8c-bf7b-020c1b06aa42-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "cinder-quobyte-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-quobyte-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[07195d1f-ac37-4968-a40a-fe08a616dce6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:39 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 Sep 09 14:44:39 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:39 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" returned: 0 in 0.473s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:39 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42 Sep 09 14:44:39 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:40 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" returned: 0 in 0.351s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-quobyte-87fa1924-da8d-4c8c-bf7b-020c1b06aa42" released by "delete_volume" :: held 0.918s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Created reservations ['d873b353-4d94-4cb2-9401-18062b602cac', '211cde0c-a678-40b2-8211-a17dd25aa7a8', 'a9719141-37b3-49a3-9e87-497a847cf90b', '65f88385-4858-4bd5-b96b-24eda9e58fb2'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:40 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:40 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:40 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.381s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Deleted volume successfully. Sep 09 14:44:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8b5c1d05-14c8-442b-9be8-1f536f387cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1524138028 None] Lock "cinder-87fa1924-da8d-4c8c-bf7b-020c1b06aa42-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Flow 'volume_create_manager' (bea14fda-ad2c-4293-8750-08d4385b4696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fceb21-9deb-48d4-b185-4098fa5bd9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fceb21-9deb-48d4-b185-4098fa5bd9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819997300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4918a495-b14e-465d-adff-bf093729c91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8881aaf2462f4a4f97b63f3f08070d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:43Z,use_quota=True,user_id='620457d59f5b48f1b6c9f0920e9dfb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66216c7f-457b-4ac2-bbf6-41a041ef0abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66216c7f-457b-4ac2-bbf6-41a041ef0abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f1874a-c7c9-4445-8f26-c9f60da5fada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f1874a-c7c9-4445-8f26-c9f60da5fada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4918a495-b14e-465d-adff-bf093729c91b', 'volume_name': 'volume-4918a495-b14e-465d-adff-bf093729c91b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29284fc8-e232-43ee-9957-e1ab1f04a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29284fc8-e232-43ee-9957-e1ab1f04a355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8f3b1-bd27-4219-9c21-bf81ab8059b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Volume 4918a495-b14e-465d-adff-bf093729c91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4918a495-b14e-465d-adff-bf093729c91b', 'volume_size': 1} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-819997300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4918a495-b14e-465d-adff-bf093729c91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8881aaf2462f4a4f97b63f3f08070d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:43Z,use_quota=True,user_id='620457d59f5b48f1b6c9f0920e9dfb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Creating volume 4918a495-b14e-465d-adff-bf093729c91b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:42 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b 1073741824 Sep 09 14:44:42 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:43 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b 1073741824" returned: 0 in 0.927s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:43 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b Sep 09 14:44:43 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:44 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8f3b1-bd27-4219-9c21-bf81ab8059b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4918a495-b14e-465d-adff-bf093729c91b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf3040f-70c9-4677-ae96-cfcac158a356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Volume volume-4918a495-b14e-465d-adff-bf093729c91b (4918a495-b14e-465d-adff-bf093729c91b): created successfully Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf3040f-70c9-4677-ae96-cfcac158a356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Flow 'volume_create_manager' (bea14fda-ad2c-4293-8750-08d4385b4696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-46f17ad0-4e4a-4d93-9c1e-efa1a6278993 tempest-ServersNegativeTestJSON-209773945 None] Created volume successfully. Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Flow 'volume_create_manager' (76352af2-5351-495f-b962-901350a392cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d0b967-072e-4c65-8386-5b998ec83a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d0b967-072e-4c65-8386-5b998ec83a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-251184210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6fbe20-3e40-4a40-9332-7de06ab3f8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8881aaf2462f4a4f97b63f3f08070d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:48Z,use_quota=True,user_id='620457d59f5b48f1b6c9f0920e9dfb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f12957b-37da-437f-8a39-66ba620c9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f12957b-37da-437f-8a39-66ba620c9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d029497b-bbef-4236-8183-cc877525b671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d029497b-bbef-4236-8183-cc877525b671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a6fbe20-3e40-4a40-9332-7de06ab3f8f2', 'volume_name': 'volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4a8329-b4af-4a16-b13c-00a1e44dca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4a8329-b4af-4a16-b13c-00a1e44dca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ec8e71-c00a-48ef-9331-f4c6f32c0a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:48 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Volume 7a6fbe20-3e40-4a40-9332-7de06ab3f8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2', 'volume_size': 1} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-251184210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6fbe20-3e40-4a40-9332-7de06ab3f8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8881aaf2462f4a4f97b63f3f08070d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:48Z,use_quota=True,user_id='620457d59f5b48f1b6c9f0920e9dfb2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Creating volume 7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:48 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:48 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 1073741824 Sep 09 14:44:48 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:49 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 1073741824" returned: 0 in 0.592s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:49 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 Sep 09 14:44:49 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:49 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2" returned: 0 in 0.472s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ec8e71-c00a-48ef-9331-f4c6f32c0a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a84ba3-b338-4b2c-acf7-2bac04c34e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:49 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Volume volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 (7a6fbe20-3e40-4a40-9332-7de06ab3f8f2): created successfully Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a84ba3-b338-4b2c-acf7-2bac04c34e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Flow 'volume_create_manager' (76352af2-5351-495f-b962-901350a392cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3e13b67d-18f5-41dc-8662-5c35c329a4f1 tempest-ServersNegativeTestJSON-209773945 None] Created volume successfully. Sep 09 14:44:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "cinder-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "cinder-quobyte-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-quobyte-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b9668-0973-4eb6-9b1d-6b3d3e6a08cc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:51 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 Sep 09 14:44:51 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:52 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2" returned: 0 in 0.702s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:52 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2 Sep 09 14:44:52 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Flow 'volume_create_manager' (2241182c-8ffc-4ec1-81c1-f739f6e80963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69795c17-54d5-4a57-b9d4-f8a826be6bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69795c17-54d5-4a57-b9d4-f8a826be6bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750050134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c622a6-4fed-4081-ad0b-680edb4fe9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101e5204125c4932a28cc2e37ff90efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:52Z,use_quota=True,user_id='4376e4e402e744b98f7e41beee04827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7234c43f-afef-4e39-846a-4e1926d25846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7234c43f-afef-4e39-846a-4e1926d25846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e541d6-9eb5-45db-aa3a-da9ffc1d5b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e541d6-9eb5-45db-aa3a-da9ffc1d5b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c622a6-4fed-4081-ad0b-680edb4fe9d3', 'volume_name': 'volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae3b6f-94f9-48ab-a9de-07ac4ae72eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae3b6f-94f9-48ab-a9de-07ac4ae72eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935eac1-3829-4d9b-bef9-635e67987bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:52 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Volume 29c622a6-4fed-4081-ad0b-680edb4fe9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3', 'volume_size': 1} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750050134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c622a6-4fed-4081-ad0b-680edb4fe9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101e5204125c4932a28cc2e37ff90efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:52Z,use_quota=True,user_id='4376e4e402e744b98f7e41beee04827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Creating volume 29c622a6-4fed-4081-ad0b-680edb4fe9d3 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:52 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:52 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 1073741824 Sep 09 14:44:52 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:52 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:52 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:52 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2" returned: 0 in 0.438s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-quobyte-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2" released by "delete_volume" :: held 1.208s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Created reservations ['dcc81d3f-3aab-405d-853a-7ad51563536b', '152e1550-d45b-427e-97e6-eb4541f506cd', '6012b3b7-ba8c-4b2b-8f22-fa5b4b75fa99', 'ca3b5413-8208-402b-af54-74562b4cd750'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:52 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.403s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:52 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:52 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:53 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 1073741824" returned: 0 in 0.903s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:53 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.400s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Deleted volume successfully. Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-94856089-a8ad-4bd7-942c-72044911e07c tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-7a6fbe20-3e40-4a40-9332-7de06ab3f8f2-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:53 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 Sep 09 14:44:53 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:53 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3" returned: 0 in 0.278s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935eac1-3829-4d9b-bef9-635e67987bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f0791-0f61-4595-b072-7f2c4c937a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "cinder-4918a495-b14e-465d-adff-bf093729c91b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Volume volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 (29c622a6-4fed-4081-ad0b-680edb4fe9d3): created successfully Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f0791-0f61-4595-b072-7f2c4c937a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Flow 'volume_create_manager' (2241182c-8ffc-4ec1-81c1-f739f6e80963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-4918a495-b14e-465d-adff-bf093729c91b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5befd74a-6645-4593-91de-0a54392b8aca tempest-VolumesListAdminTestJSON-287811525 None] Created volume successfully. Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "cinder-quobyte-4918a495-b14e-465d-adff-bf093729c91b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-quobyte-4918a495-b14e-465d-adff-bf093729c91b" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b6eb72-c836-4bb7-9897-22db65284319]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:44:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:53 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b Sep 09 14:44:53 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:54 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b" returned: 0 in 0.427s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:54 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b Sep 09 14:44:54 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:54 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4918a495-b14e-465d-adff-bf093729c91b" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-quobyte-4918a495-b14e-465d-adff-bf093729c91b" released by "delete_volume" :: held 0.786s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Created reservations ['cb61c284-f8ea-4862-b0ef-54d964c67da0', '79fbe82d-5deb-482f-9f7b-e82a0450bad2', '891babf8-b901-4c4d-9c6b-c5682080bea6', '1dbda45a-7114-4b2b-9cc1-b69efe36e805'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:54 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:44:54 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:55 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.305s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:44:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Deleted volume successfully. Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be19f7c5-3841-4a83-9f79-4d947f79149f tempest-ServersNegativeTestJSON-209773945 None] Lock "cinder-4918a495-b14e-465d-adff-bf093729c91b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Flow 'volume_create_manager' (5e7c3c60-0a23-4f81-ac7b-cee344204d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5067df9d-28b0-436d-bd1f-2b4b0ce7a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5067df9d-28b0-436d-bd1f-2b4b0ce7a11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-640847665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9bc657-6ce6-4564-bfed-c16a10ee8ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101e5204125c4932a28cc2e37ff90efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:55Z,use_quota=True,user_id='4376e4e402e744b98f7e41beee04827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e963117-411a-49b9-830a-02c28a5caf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e963117-411a-49b9-830a-02c28a5caf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a02a60b-183e-4c18-94f5-52c1f49be91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a02a60b-183e-4c18-94f5-52c1f49be91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9bc657-6ce6-4564-bfed-c16a10ee8ba9', 'volume_name': 'volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0e6809-8f7b-4e75-b7f5-8ef31167125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0e6809-8f7b-4e75-b7f5-8ef31167125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f357a4-645d-4f93-b277-6ca1d38d453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:55 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Volume 8b9bc657-6ce6-4564-bfed-c16a10ee8ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9', 'volume_size': 1} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-640847665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9bc657-6ce6-4564-bfed-c16a10ee8ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101e5204125c4932a28cc2e37ff90efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:55Z,use_quota=True,user_id='4376e4e402e744b98f7e41beee04827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Creating volume 8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:55 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:55 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 1073741824 Sep 09 14:44:55 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:56 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 1073741824" returned: 0 in 0.807s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:56 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 Sep 09 14:44:56 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:56 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9" returned: 0 in 0.400s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f357a4-645d-4f93-b277-6ca1d38d453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22c944a-9680-4cf4-bb5a-06a797ba4c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:56 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Volume volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 (8b9bc657-6ce6-4564-bfed-c16a10ee8ba9): created successfully Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22c944a-9680-4cf4-bb5a-06a797ba4c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Flow 'volume_create_manager' (5e7c3c60-0a23-4f81-ac7b-cee344204d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2249690c-4465-4565-a87d-2d3741fff50d tempest-VolumesListAdminTestJSON-287811525 None] Created volume successfully. Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Flow 'volume_create_manager' (b3d613cb-ce55-4df3-bbf9-db0c0ba951ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199575e3-8b36-4683-a6f5-6562b2536720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199575e3-8b36-4683-a6f5-6562b2536720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1511356261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfb2837-5fe9-4319-8567-b089cc142f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101e5204125c4932a28cc2e37ff90efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:58Z,use_quota=True,user_id='4376e4e402e744b98f7e41beee04827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d621d8-ef30-4ee7-8dd7-13f2c0c34f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d621d8-ef30-4ee7-8dd7-13f2c0c34f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c004c0-a47c-4947-a3ac-3c35b2a7f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c004c0-a47c-4947-a3ac-3c35b2a7f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfb2837-5fe9-4319-8567-b089cc142f69', 'volume_name': 'volume-8dfb2837-5fe9-4319-8567-b089cc142f69', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119fa267-ef0e-43a0-bd63-f0f7be6cc071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119fa267-ef0e-43a0-bd63-f0f7be6cc071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064f1f31-8168-49a0-b572-344a101e6799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:58 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Volume 8dfb2837-5fe9-4319-8567-b089cc142f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfb2837-5fe9-4319-8567-b089cc142f69', 'volume_size': 1} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1511356261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfb2837-5fe9-4319-8567-b089cc142f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101e5204125c4932a28cc2e37ff90efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:44:58Z,use_quota=True,user_id='4376e4e402e744b98f7e41beee04827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Creating volume 8dfb2837-5fe9-4319-8567-b089cc142f69 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:44:58 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:58 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 1073741824 Sep 09 14:44:58 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:58 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 1073741824" returned: 0 in 0.603s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:44:59 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 Sep 09 14:44:59 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:44:59 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69" returned: 0 in 0.313s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064f1f31-8168-49a0-b572-344a101e6799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfb2837-5fe9-4319-8567-b089cc142f69', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01fec62-51c4-4049-9689-dd17a8fce582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:44:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Volume volume-8dfb2837-5fe9-4319-8567-b089cc142f69 (8dfb2837-5fe9-4319-8567-b089cc142f69): created successfully Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01fec62-51c4-4049-9689-dd17a8fce582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:44:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Flow 'volume_create_manager' (b3d613cb-ce55-4df3-bbf9-db0c0ba951ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:44:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7331ab71-9483-40e5-92e5-b16968dce16c tempest-VolumesListAdminTestJSON-287811525 None] Created volume successfully. Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Flow 'volume_create_manager' (6f662a77-ff8b-4366-a8cd-1c8036c9e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7170d0a4-ec1a-4cf4-b4a3-b959df44e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7170d0a4-ec1a-4cf4-b4a3-b959df44e155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b669fac2-a075-44b8-90b7-eec4cf348130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2289ea956ade44debf32a81a3e135c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:01Z,use_quota=True,user_id='3869b73b3d9d4316965d605dd8fbb45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c4c77e-10fc-4620-ab09-427af3fafd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c4c77e-10fc-4620-ab09-427af3fafd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631a0121-30b0-468d-990a-4ee3a3cc3858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631a0121-30b0-468d-990a-4ee3a3cc3858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b669fac2-a075-44b8-90b7-eec4cf348130', 'volume_name': 'volume-b669fac2-a075-44b8-90b7-eec4cf348130', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8eb3d5c-24b5-4b92-8612-58112e42d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8eb3d5c-24b5-4b92-8612-58112e42d976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2cca45-b00f-4f43-8b33-7d8edb26577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:01 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Volume b669fac2-a075-44b8-90b7-eec4cf348130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b669fac2-a075-44b8-90b7-eec4cf348130', 'volume_size': 1} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b669fac2-a075-44b8-90b7-eec4cf348130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2289ea956ade44debf32a81a3e135c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:01Z,use_quota=True,user_id='3869b73b3d9d4316965d605dd8fbb45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Creating volume b669fac2-a075-44b8-90b7-eec4cf348130 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:45:01 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:45:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:01 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 1073741824 Sep 09 14:45:01 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:02 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 1073741824" returned: 0 in 0.517s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:02 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 Sep 09 14:45:02 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:02 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130" returned: 0 in 0.249s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2cca45-b00f-4f43-8b33-7d8edb26577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b669fac2-a075-44b8-90b7-eec4cf348130', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6fb820-21cd-4101-a6eb-2d4bf56ae59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:02 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Volume volume-b669fac2-a075-44b8-90b7-eec4cf348130 (b669fac2-a075-44b8-90b7-eec4cf348130): created successfully Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6fb820-21cd-4101-a6eb-2d4bf56ae59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Flow 'volume_create_manager' (6f662a77-ff8b-4366-a8cd-1c8036c9e22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3bf89daf-e7bc-4119-8215-f1cff648b782 tempest-VolumesListAdminTestJSON-1200510638 None] Created volume successfully. Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Acquiring lock "cinder-b669fac2-a075-44b8-90b7-eec4cf348130-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "cinder-b669fac2-a075-44b8-90b7-eec4cf348130-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Acquiring lock "cinder-quobyte-b669fac2-a075-44b8-90b7-eec4cf348130" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "cinder-quobyte-b669fac2-a075-44b8-90b7-eec4cf348130" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d33f2-f0f1-4c5b-b789-eabff75164a8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "cinder-8dfb2837-5fe9-4319-8567-b089cc142f69-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-8dfb2837-5fe9-4319-8567-b089cc142f69-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "cinder-quobyte-8dfb2837-5fe9-4319-8567-b089cc142f69" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-quobyte-8dfb2837-5fe9-4319-8567-b089cc142f69" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:04 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 Sep 09 14:45:04 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac993143-5988-4346-8ff0-81aecd047ca7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:04 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 Sep 09 14:45:04 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:04 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130" returned: 0 in 0.528s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:04 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130 Sep 09 14:45:04 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:04 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69" returned: 0 in 0.456s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:04 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69 Sep 09 14:45:04 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:04 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b669fac2-a075-44b8-90b7-eec4cf348130" returned: 0 in 0.375s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "cinder-quobyte-b669fac2-a075-44b8-90b7-eec4cf348130" released by "delete_volume" :: held 0.971s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Created reservations ['d3383a0d-b472-43f1-b234-c8718c9a8a99', '23f19f09-a3b8-4e5c-9395-1ae4fd3c31d7', '4a17ae89-6ea7-4b17-a10b-7e152fe13f12', '585b92fa-7730-4ff1-a04b-e8c09a2496da'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:45:04 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8dfb2837-5fe9-4319-8567-b089cc142f69" returned: 0 in 0.345s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-quobyte-8dfb2837-5fe9-4319-8567-b089cc142f69" released by "delete_volume" :: held 0.864s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:04 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:04 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Created reservations ['7cfd229a-032c-4e8c-8e3c-819cef54a734', 'bf5d9dbc-0980-4cb3-a70a-77d81b8c801c', '18fb3a0f-e0ae-400c-bae4-a1d2bc460039', 'eb8c5d70-3e44-4ae2-b029-7e8233a1d906'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:05 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:05 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:05 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.434s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Deleted volume successfully. Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c678ea0a-d7ab-4072-87ba-186af1f21ca6 tempest-VolumesListAdminTestJSON-1200510638 None] Lock "cinder-b669fac2-a075-44b8-90b7-eec4cf348130-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:05 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.418s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Deleted volume successfully. Sep 09 14:45:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2f1f94bb-5c15-461d-8378-98e07192c847 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-8dfb2837-5fe9-4319-8567-b089cc142f69-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "cinder-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "cinder-quobyte-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-quobyte-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:06 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e64bd2-d6a0-462e-a1a1-859757ae8190]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:06 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 Sep 09 14:45:06 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:07 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9" returned: 0 in 0.560s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:07 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9 Sep 09 14:45:07 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:07 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9" returned: 0 in 0.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-quobyte-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9" released by "delete_volume" :: held 1.041s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Created reservations ['5920a70b-9884-4933-8045-ba31071af570', '7ec47ebe-265b-4c37-9dd3-ddaefdaafbc1', '8407f5b9-6853-4c92-b428-ab13bcc8ef04', 'a6ebc50b-1658-4e72-9b09-b3258e259103'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:07 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:07 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:08 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.374s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Deleted volume successfully. Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a95cbb6-db89-4990-95e8-6d2dcc408e2a tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-8b9bc657-6ce6-4564-bfed-c16a10ee8ba9-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "cinder-29c622a6-4fed-4081-ad0b-680edb4fe9d3-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-29c622a6-4fed-4081-ad0b-680edb4fe9d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "cinder-quobyte-29c622a6-4fed-4081-ad0b-680edb4fe9d3" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-quobyte-29c622a6-4fed-4081-ad0b-680edb4fe9d3" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87dcde-f43e-46c6-971a-0162cefa92bc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:09 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 Sep 09 14:45:09 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:09 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3" returned: 0 in 0.471s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:09 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3 Sep 09 14:45:09 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:09 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29c622a6-4fed-4081-ad0b-680edb4fe9d3" returned: 0 in 0.343s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-quobyte-29c622a6-4fed-4081-ad0b-680edb4fe9d3" released by "delete_volume" :: held 0.884s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Created reservations ['2f77ebd0-1e93-49eb-8b2f-eb48bd886ac0', '5041e503-367f-468b-b530-311c5ee9d7b1', '0239bb53-a215-4ca3-8104-8233e2d52844', 'e412d35d-dc82-49e4-838d-8de83798e6b5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:10 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:10 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:10 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.435s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:10 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Deleted volume successfully. Sep 09 14:45:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e039bceb-ca73-4631-854d-0c2aed396079 tempest-VolumesListAdminTestJSON-287811525 None] Lock "cinder-29c622a6-4fed-4081-ad0b-680edb4fe9d3-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Flow 'volume_create_manager' (05fa2376-2024-4aed-aeef-304970ca82ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2ffdd6-3af3-47eb-8469-f20289897d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2ffdd6-3af3-47eb-8469-f20289897d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-134030053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53020de-f1d6-481b-9c1c-8541d380031c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63664834245647eb8cc8d72d58b4f29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:15Z,use_quota=True,user_id='53c991a1739a4610ad4b146d66ef57ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff5e9f-9e65-482d-8524-14b5506521f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff5e9f-9e65-482d-8524-14b5506521f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a354a3-7ad1-4013-b02f-180d6fd14df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a354a3-7ad1-4013-b02f-180d6fd14df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53020de-f1d6-481b-9c1c-8541d380031c', 'volume_name': 'volume-f53020de-f1d6-481b-9c1c-8541d380031c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af356b6-b521-4e82-9b70-d8d7ccd74372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af356b6-b521-4e82-9b70-d8d7ccd74372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31eb9a2f-323c-41a6-8529-cea172152061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:14 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Volume f53020de-f1d6-481b-9c1c-8541d380031c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53020de-f1d6-481b-9c1c-8541d380031c', 'volume_size': 1} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-134030053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53020de-f1d6-481b-9c1c-8541d380031c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63664834245647eb8cc8d72d58b4f29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:15Z,use_quota=True,user_id='53c991a1739a4610ad4b146d66ef57ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Creating volume f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:45:14 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:45:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:14 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c 1073741824 Sep 09 14:45:14 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:15 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c 1073741824" returned: 0 in 0.621s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:15 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c Sep 09 14:45:15 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:15 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c" returned: 0 in 0.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31eb9a2f-323c-41a6-8529-cea172152061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53020de-f1d6-481b-9c1c-8541d380031c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbe369b-1366-4c6d-a167-4ca40b79c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:16 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Volume volume-f53020de-f1d6-481b-9c1c-8541d380031c (f53020de-f1d6-481b-9c1c-8541d380031c): created successfully Sep 09 14:45:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbe369b-1366-4c6d-a167-4ca40b79c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Flow 'volume_create_manager' (05fa2376-2024-4aed-aeef-304970ca82ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3cfc598d-5c47-4ae2-96e9-423a02f02118 tempest-TestImageHashVerification-933563398 None] Created volume successfully. Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[83537f6a-e97c-43bf-a97b-852070030139]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:18 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c Sep 09 14:45:18 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:18 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c" returned: 0 in 0.505s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3607b1e9-8356-4d0a-8778-b533e59697cc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:18 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c Sep 09 14:45:18 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:19 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c /opt/stack/data/cinder/conversion/f53020de-f1d6-481b-9c1c-8541d380031c.temp_image.87497d9f-6ec1-401a-9ce3-a2af12e19d41nl0_xtm9.img {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:19 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c /opt/stack/data/cinder/conversion/f53020de-f1d6-481b-9c1c-8541d380031c.temp_image.87497d9f-6ec1-401a-9ce3-a2af12e19d41nl0_xtm9.img Sep 09 14:45:19 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:24 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c /opt/stack/data/cinder/conversion/f53020de-f1d6-481b-9c1c-8541d380031c.temp_image.87497d9f-6ec1-401a-9ce3-a2af12e19d41nl0_xtm9.img" returned: 0 in 5.823s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5952f59-8a75-46bc-94ae-998a3787059b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=74,cinder:INSERT=25,cinder:UPDATE=105,cinder:DELETE=10 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:45:25 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c Sep 09 14:45:25 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=79,cinder:INSERT=28,cinder:UPDATE=113,cinder:DELETE=8 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:45:25 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c" returned: 0 in 0.838s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/conversion/f53020de-f1d6-481b-9c1c-8541d380031c.temp_image.87497d9f-6ec1-401a-9ce3-a2af12e19d41nl0_xtm9.img {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:45:25 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Converted 1024.00 MB image at 175.81 MB/s Sep 09 14:45:25 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] 87497d9f-6ec1-401a-9ce3-a2af12e19d41 was raw, no need to convert to raw {{(pid=87325) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Flow 'volume_create_manager' (82862ff2-6efc-4b37-9ee3-017bc50d49cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741d7a8f-f538-4b2a-9449-1f05ec32af73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741d7a8f-f538-4b2a-9449-1f05ec32af73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-366443786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6dd0a8-99e1-4e33-a022-fb05667ab5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602c28d266614b9d81b4972b9a101297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:35Z,use_quota=True,user_id='a1ccef0380f74eb9a90cd6f5a0599776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d175839-30ea-4b8f-8553-61023572d5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d175839-30ea-4b8f-8553-61023572d5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803744d1-f91a-457e-b39b-90a7e8ca4e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803744d1-f91a-457e-b39b-90a7e8ca4e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6dd0a8-99e1-4e33-a022-fb05667ab5ec', 'volume_name': 'volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c3ad88-cc88-4c50-b8d5-ad1020683389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c3ad88-cc88-4c50-b8d5-ad1020683389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3dc9f9e-727d-4f69-bf0a-67eb8cd9bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:35 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Volume 9c6dd0a8-99e1-4e33-a022-fb05667ab5ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec', 'volume_size': 1} Sep 09 14:45:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:45 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:45:45 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:52 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:52 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:52 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:45:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.906s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Uploaded volume to glance image-id: 87497d9f-6ec1-401a-9ce3-a2af12e19d41. {{(pid=87325) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.740s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-366443786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6dd0a8-99e1-4e33-a022-fb05667ab5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602c28d266614b9d81b4972b9a101297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:35Z,use_quota=True,user_id='a1ccef0380f74eb9a90cd6f5a0599776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Creating volume 9c6dd0a8-99e1-4e33-a022-fb05667ab5ec {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:45:55 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:55 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec 1073741824 Sep 09 14:45:55 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9f40a532-c2dd-48a1-9f4b-867d84cc78e6 tempest-TestImageHashVerification-933563398 None] Copy volume to image completed successfully. Sep 09 14:45:55 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec 1073741824" returned: 0 in 0.491s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:55 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec Sep 09 14:45:55 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:55 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec" returned: 0 in 0.302s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Acquiring lock "cinder-f53020de-f1d6-481b-9c1c-8541d380031c-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3dc9f9e-727d-4f69-bf0a-67eb8cd9bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dc05ca-0c82-4eed-806b-e389d5863f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Lock "cinder-f53020de-f1d6-481b-9c1c-8541d380031c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:55 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Volume volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec (9c6dd0a8-99e1-4e33-a022-fb05667ab5ec): created successfully Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dc05ca-0c82-4eed-806b-e389d5863f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Flow 'volume_create_manager' (82862ff2-6efc-4b37-9ee3-017bc50d49cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-00680c99-85d2-466e-b76a-7e24cdc005e6 tempest-VolumesTransfersTest-1890997404 None] Created volume successfully. Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Acquiring lock "cinder-quobyte-f53020de-f1d6-481b-9c1c-8541d380031c" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Lock "cinder-quobyte-f53020de-f1d6-481b-9c1c-8541d380031c" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ab93c-38d3-4b82-a5be-dea491b5add7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:56 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c Sep 09 14:45:56 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:56 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c" returned: 0 in 0.387s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:56 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c Sep 09 14:45:56 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:56 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f53020de-f1d6-481b-9c1c-8541d380031c" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Lock "cinder-quobyte-f53020de-f1d6-481b-9c1c-8541d380031c" released by "delete_volume" :: held 0.725s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Created reservations ['451f43ae-4608-45cb-bd6a-fb2a8a1d0dc5', '9e78514f-de55-4081-b8d3-714d751d35e5', '00214041-77e2-4c97-9ce4-61468472955b', 'b5d3308a-c94e-4678-8d99-735dfff81e20'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:56 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:56 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-04b107ed-0ff3-4fb0-8972-a481a5a01d00 tempest-VolumesTransfersTest-1947495439 None] Transfer volume completed successfully. Sep 09 14:45:57 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.305s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Deleted volume successfully. Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-065ea9bd-711f-4428-a166-000bbd3c4482 tempest-TestImageHashVerification-933563398 None] Lock "cinder-f53020de-f1d6-481b-9c1c-8541d380031c-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Acquiring lock "cinder-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Acquiring lock "cinder-quobyte-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-quobyte-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0faf3fd-a26b-4596-9b62-daa007ee0ddb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:45:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:57 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec Sep 09 14:45:57 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:58 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec" returned: 0 in 0.460s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:58 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec Sep 09 14:45:58 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Flow 'volume_create_manager' (df23a7b0-e2af-4ae9-b746-e85813527bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e40211e-ea04-48f2-8c6d-b09cfc2aa87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:58 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec" returned: 0 in 0.311s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e40211e-ea04-48f2-8c6d-b09cfc2aa87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1988456926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df77564c-e90a-4fa6-b930-53b52c0e97e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae0c5fb464945d9a2cd85c7654f2143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:58Z,use_quota=True,user_id='a2d522e76b1349be8562fc0a2458efd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940b9738-469c-40e0-9e4b-9a9bdea43bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940b9738-469c-40e0-9e4b-9a9bdea43bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaa8974-95df-464c-a824-d29dff4b0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaa8974-95df-464c-a824-d29dff4b0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df77564c-e90a-4fa6-b930-53b52c0e97e0', 'volume_name': 'volume-df77564c-e90a-4fa6-b930-53b52c0e97e0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898fc57b-4776-43ef-9b34-3f06c57ba679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898fc57b-4776-43ef-9b34-3f06c57ba679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29d1c9d-3b9e-4617-b12f-900d0c5883d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:58 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Volume df77564c-e90a-4fa6-b930-53b52c0e97e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df77564c-e90a-4fa6-b930-53b52c0e97e0', 'volume_size': 1} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1988456926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df77564c-e90a-4fa6-b930-53b52c0e97e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae0c5fb464945d9a2cd85c7654f2143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:58Z,use_quota=True,user_id='a2d522e76b1349be8562fc0a2458efd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Creating volume df77564c-e90a-4fa6-b930-53b52c0e97e0 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:45:58 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-quobyte-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec" released by "delete_volume" :: held 0.878s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:58 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 1073741824 Sep 09 14:45:58 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Created reservations ['e78802e2-0282-44af-ba42-a72be1f93a2e', 'ed8bc271-a891-4904-b265-34a8f284117d', '0b9cff6a-7a3f-44cf-a366-1ecadef4bad8', 'f5cb64cd-7465-40af-85fb-a1df8ea0ee7e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:58 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:45:58 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:59 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.308s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:45:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Deleted volume successfully. Sep 09 14:45:59 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 1073741824" returned: 0 in 0.549s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ab36e6f-9fce-46df-b696-5f7939fceaa2 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-9c6dd0a8-99e1-4e33-a022-fb05667ab5ec-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:59 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 Sep 09 14:45:59 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Flow 'volume_create_manager' (e6eecc0d-4d35-42be-b3a0-649dbdad6852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:59 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f9fd3f-b0f9-4d19-b27b-14c59a9daddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0" returned: 0 in 0.308s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f9fd3f-b0f9-4d19-b27b-14c59a9daddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1446876161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bc731f-3b56-40e2-b751-490e060d7cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602c28d266614b9d81b4972b9a101297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:59Z,use_quota=True,user_id='a1ccef0380f74eb9a90cd6f5a0599776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3325c44-72f4-4a23-bb4e-ea7745e0e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3325c44-72f4-4a23-bb4e-ea7745e0e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e33d32a-6d06-4db8-9370-562d5cb0eb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e33d32a-6d06-4db8-9370-562d5cb0eb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48bc731f-3b56-40e2-b751-490e060d7cc4', 'volume_name': 'volume-48bc731f-3b56-40e2-b751-490e060d7cc4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fce4342-300c-4eba-8825-4cefaae0a29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fce4342-300c-4eba-8825-4cefaae0a29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1b936e-57a0-420f-baad-344289147656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Volume 48bc731f-3b56-40e2-b751-490e060d7cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48bc731f-3b56-40e2-b751-490e060d7cc4', 'volume_size': 1} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1446876161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bc731f-3b56-40e2-b751-490e060d7cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602c28d266614b9d81b4972b9a101297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:45:59Z,use_quota=True,user_id='a1ccef0380f74eb9a90cd6f5a0599776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Creating volume 48bc731f-3b56-40e2-b751-490e060d7cc4 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:45:59 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29d1c9d-3b9e-4617-b12f-900d0c5883d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df77564c-e90a-4fa6-b930-53b52c0e97e0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9901b3bb-94f1-4923-9a98-c7e391b28606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:45:59 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 1073741824 Sep 09 14:45:59 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:45:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Volume volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 (df77564c-e90a-4fa6-b930-53b52c0e97e0): created successfully Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9901b3bb-94f1-4923-9a98-c7e391b28606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:45:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Flow 'volume_create_manager' (df23a7b0-e2af-4ae9-b746-e85813527bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:45:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f32f4fac-e38d-4ec8-8ed9-c56697f0d6db tempest-AttachVolumeTestJSON-1925831657 None] Created volume successfully. Sep 09 14:46:00 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 1073741824" returned: 0 in 0.489s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:00 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 Sep 09 14:46:00 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:00 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4" returned: 0 in 0.242s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1b936e-57a0-420f-baad-344289147656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bc731f-3b56-40e2-b751-490e060d7cc4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dfe56e-552a-4c21-8861-fef4139c1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Volume volume-48bc731f-3b56-40e2-b751-490e060d7cc4 (48bc731f-3b56-40e2-b751-490e060d7cc4): created successfully Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dfe56e-552a-4c21-8861-fef4139c1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Flow 'volume_create_manager' (e6eecc0d-4d35-42be-b3a0-649dbdad6852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:00 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1e206b05-c875-4900-86b2-61e1bb00f3df tempest-VolumesTransfersTest-1890997404 None] Created volume successfully. Sep 09 14:46:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-01acf18b-3f9e-4cf0-9e41-af9044882329 req-bf10fd3b-24d7-4642-96af-2c55bdff38d2 tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-01acf18b-3f9e-4cf0-9e41-af9044882329 req-bf10fd3b-24d7-4642-96af-2c55bdff38d2 tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-01acf18b-3f9e-4cf0-9e41-af9044882329 req-bf10fd3b-24d7-4642-96af-2c55bdff38d2 tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-01acf18b-3f9e-4cf0-9e41-af9044882329 req-bf10fd3b-24d7-4642-96af-2c55bdff38d2 tempest-AttachVolumeTestJSON-1925831657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-df77564c-e90a-4fa6-b930-53b52c0e97e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8acd99c2-5417-4afc-9015-b4338a4ed11c', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:46:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-01acf18b-3f9e-4cf0-9e41-af9044882329 req-bf10fd3b-24d7-4642-96af-2c55bdff38d2 tempest-AttachVolumeTestJSON-1925831657 None] attachment_update completed successfully. Sep 09 14:46:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Acquiring lock "cinder-48bc731f-3b56-40e2-b751-490e060d7cc4-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-48bc731f-3b56-40e2-b751-490e060d7cc4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Acquiring lock "cinder-quobyte-48bc731f-3b56-40e2-b751-490e060d7cc4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-quobyte-48bc731f-3b56-40e2-b751-490e060d7cc4" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb08e9-0657-47d3-9787-5b440b3208cb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:02 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 Sep 09 14:46:02 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:02 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4" returned: 0 in 0.469s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:02 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4 Sep 09 14:46:02 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:02 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48bc731f-3b56-40e2-b751-490e060d7cc4" returned: 0 in 0.389s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-quobyte-48bc731f-3b56-40e2-b751-490e060d7cc4" released by "delete_volume" :: held 0.916s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Created reservations ['8a9f1af6-f914-4c5b-a2ec-b5c383f32df9', 'f5994d6c-f776-48e0-9f61-b5b6b4312d1f', 'b9100ae4-e86b-43e7-b8e3-e7b68d5212ce', '872f84a9-9e99-483e-8fea-82376da230a1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:03 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:03 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:03 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.355s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Deleted volume successfully. Sep 09 14:46:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-83e7f5a0-302b-4f41-98d2-080acb7746d8 tempest-VolumesTransfersTest-1941496973 None] Lock "cinder-48bc731f-3b56-40e2-b751-490e060d7cc4-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Flow 'volume_create_manager' (b054c2af-8124-48ca-95ac-2a2d59254143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc6622-2f5d-4123-b587-546314d3a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc6622-2f5d-4123-b587-546314d3a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727461555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e9c5af-3a0a-4b9f-a442-f9457a339876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae0c5fb464945d9a2cd85c7654f2143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:05Z,use_quota=True,user_id='a2d522e76b1349be8562fc0a2458efd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692ae638-9f08-4291-96f1-7948316b698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692ae638-9f08-4291-96f1-7948316b698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8db2d0e-d593-4124-b8c0-33aea0cc9524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8db2d0e-d593-4124-b8c0-33aea0cc9524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e9c5af-3a0a-4b9f-a442-f9457a339876', 'volume_name': 'volume-71e9c5af-3a0a-4b9f-a442-f9457a339876', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3d2330-9e16-4704-ba75-581f46ad9d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3d2330-9e16-4704-ba75-581f46ad9d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbde968-5d5f-4b4b-a670-cb09ca8fa420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:04 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Volume 71e9c5af-3a0a-4b9f-a442-f9457a339876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e9c5af-3a0a-4b9f-a442-f9457a339876', 'volume_size': 1} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727461555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e9c5af-3a0a-4b9f-a442-f9457a339876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae0c5fb464945d9a2cd85c7654f2143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:05Z,use_quota=True,user_id='a2d522e76b1349be8562fc0a2458efd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Creating volume 71e9c5af-3a0a-4b9f-a442-f9457a339876 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:04 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:04 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 1073741824 Sep 09 14:46:04 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:05 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 1073741824" returned: 0 in 0.695s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:05 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 Sep 09 14:46:05 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:05 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbde968-5d5f-4b4b-a670-cb09ca8fa420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e9c5af-3a0a-4b9f-a442-f9457a339876', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17b0f73-ee9b-442a-802f-92020cd08217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:05 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Volume volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 (71e9c5af-3a0a-4b9f-a442-f9457a339876): created successfully Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17b0f73-ee9b-442a-802f-92020cd08217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Flow 'volume_create_manager' (b054c2af-8124-48ca-95ac-2a2d59254143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0c6b6cf9-0edc-4ea8-9bdc-6cf8f1798e4d tempest-AttachVolumeTestJSON-1925831657 None] Created volume successfully. Sep 09 14:46:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b94eebda-ca3a-4d91-8994-ec2cda02b12c req-7aac9385-96ce-4e91-adf1-b771333c7be6 tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b94eebda-ca3a-4d91-8994-ec2cda02b12c req-7aac9385-96ce-4e91-adf1-b771333c7be6 tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b94eebda-ca3a-4d91-8994-ec2cda02b12c req-7aac9385-96ce-4e91-adf1-b771333c7be6 tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-b94eebda-ca3a-4d91-8994-ec2cda02b12c req-7aac9385-96ce-4e91-adf1-b771333c7be6 tempest-AttachVolumeTestJSON-1925831657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-71e9c5af-3a0a-4b9f-a442-f9457a339876', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19237960-092b-40d9-b493-0dc55aa99ff7', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:46:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-b94eebda-ca3a-4d91-8994-ec2cda02b12c req-7aac9385-96ce-4e91-adf1-b771333c7be6 tempest-AttachVolumeTestJSON-1925831657 None] attachment_update completed successfully. Sep 09 14:46:08 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Flow 'volume_create_manager' (eaa65780-2d57-4bad-a8f7-084dbcd6b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b96de69-56f4-44c4-876a-95203cb308df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b96de69-56f4-44c4-876a-95203cb308df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-743212416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65781205-1042-4dc1-8277-8e45d4bdc179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bb9ecab7a04ad28a3a93c37dd488bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:09Z,use_quota=True,user_id='a2f25361c63a4d629b00418b10c76c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73acb966-27e2-46d9-acf8-87187e2c1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73acb966-27e2-46d9-acf8-87187e2c1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5621b0f-3f70-4019-9847-631d9425060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5621b0f-3f70-4019-9847-631d9425060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65781205-1042-4dc1-8277-8e45d4bdc179', 'volume_name': 'volume-65781205-1042-4dc1-8277-8e45d4bdc179', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff93e71d-53cd-4c70-b062-9b751c640a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff93e71d-53cd-4c70-b062-9b751c640a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69dc31d-90a4-45fc-8dd8-01fd3bfe094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:09 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Volume 65781205-1042-4dc1-8277-8e45d4bdc179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65781205-1042-4dc1-8277-8e45d4bdc179', 'volume_size': 1} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-743212416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65781205-1042-4dc1-8277-8e45d4bdc179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bb9ecab7a04ad28a3a93c37dd488bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:09Z,use_quota=True,user_id='a2f25361c63a4d629b00418b10c76c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Creating volume 65781205-1042-4dc1-8277-8e45d4bdc179 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:09 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:09 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 1073741824 Sep 09 14:46:09 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:09 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 1073741824" returned: 0 in 0.568s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:09 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 Sep 09 14:46:09 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:09 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-8675101b-6de4-4653-87e4-207d363f0447 req-a28cecbd-3002-4e40-952f-10b25eb9353b tempest-AttachVolumeTestJSON-1925831657 None] Terminate volume connection completed successfully. Sep 09 14:46:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-8675101b-6de4-4653-87e4-207d363f0447 req-a28cecbd-3002-4e40-952f-10b25eb9353b tempest-AttachVolumeTestJSON-1925831657 None] Deleting attachment 8acd99c2-5417-4afc-9015-b4338a4ed11c. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:46:10 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69dc31d-90a4-45fc-8dd8-01fd3bfe094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65781205-1042-4dc1-8277-8e45d4bdc179', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3169b584-2781-41dc-b4d0-342b4538fbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:10 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Volume volume-65781205-1042-4dc1-8277-8e45d4bdc179 (65781205-1042-4dc1-8277-8e45d4bdc179): created successfully Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3169b584-2781-41dc-b4d0-342b4538fbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Flow 'volume_create_manager' (eaa65780-2d57-4bad-a8f7-084dbcd6b481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-683b9c03-8af8-46be-bc1d-c637f5814370 tempest-AttachVolumeShelveTestJSON-390536807 None] Created volume successfully. Sep 09 14:46:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-21436f02-75bb-4da5-b859-99f5feda2a04 req-89c7b327-6d99-4e0d-a4ae-c7dd82b5d16b tempest-AttachVolumeTestJSON-1925831657 None] Terminate volume connection completed successfully. Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-21436f02-75bb-4da5-b859-99f5feda2a04 req-89c7b327-6d99-4e0d-a4ae-c7dd82b5d16b tempest-AttachVolumeTestJSON-1925831657 None] Deleting attachment 19237960-092b-40d9-b493-0dc55aa99ff7. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Flow 'volume_create_manager' (10354e17-e067-4283-96d8-8f9d4bb96008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84494dc-4b78-4f9e-902a-f4b4758b36f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84494dc-4b78-4f9e-902a-f4b4758b36f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1490620106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc94ab83-0b26-40ec-a0b9-b028bb6d6817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a8451a078742eab1927545b616dc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:12Z,use_quota=True,user_id='c3e100c89a974556b1388b0697139e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2be6771-b7ef-425e-8737-f45d82f94a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2be6771-b7ef-425e-8737-f45d82f94a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01180ceb-5a19-4b4b-8a9c-d3bd71255d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01180ceb-5a19-4b4b-8a9c-d3bd71255d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'volume_name': 'volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28ead43-6404-4865-be38-1cc5e16d2fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28ead43-6404-4865-be38-1cc5e16d2fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2f142e-62ec-4675-a023-8599f273bb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:11 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Volume cc94ab83-0b26-40ec-a0b9-b028bb6d6817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'volume_size': 1} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1490620106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc94ab83-0b26-40ec-a0b9-b028bb6d6817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a8451a078742eab1927545b616dc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:12Z,use_quota=True,user_id='c3e100c89a974556b1388b0697139e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Creating volume cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:11 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:11 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 1073741824 Sep 09 14:46:11 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:12 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 1073741824" returned: 0 in 0.636s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:12 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 Sep 09 14:46:12 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:12 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" returned: 0 in 0.344s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2f142e-62ec-4675-a023-8599f273bb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716cb826-ddd5-4f54-85f6-ded3e126d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:12 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Volume volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 (cc94ab83-0b26-40ec-a0b9-b028bb6d6817): created successfully Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716cb826-ddd5-4f54-85f6-ded3e126d5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Flow 'volume_create_manager' (10354e17-e067-4283-96d8-8f9d4bb96008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-15ec0011-85c4-4b84-8773-f5f4eaea8a11 tempest-VolumesCloneTest-1957624502 None] Created volume successfully. Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Flow 'volume_create_manager' (7713d3ac-d911-4696-89a0-a218f052489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1820438f-67e9-45b6-8e77-101a4ee0dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1820438f-67e9-45b6-8e77-101a4ee0dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1672652743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b07d1c-9c21-4fa1-bcf5-d272c69b02c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a8451a078742eab1927545b616dc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cc94ab83-0b26-40ec-a0b9-b028bb6d6817,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:14Z,use_quota=True,user_id='c3e100c89a974556b1388b0697139e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37788d7f-7d3a-4f56-909d-0aa402756e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37788d7f-7d3a-4f56-909d-0aa402756e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9397e6-30f5-469c-a9cc-f01c2993857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9397e6-30f5-469c-a9cc-f01c2993857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '68b07d1c-9c21-4fa1-bcf5-d272c69b02c6', 'volume_name': 'volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6', 'volume_size': 2, 'source_volid': 'cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'source_volstatus': 'available'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d42925d-43fa-4fd4-99dd-ffad42e2ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d42925d-43fa-4fd4-99dd-ffad42e2ae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8da20e-7254-4de0-8fd6-a42f7e19a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:14 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Volume 68b07d1c-9c21-4fa1-bcf5-d272c69b02c6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6', 'volume_size': 2, 'source_volid': 'cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'source_volstatus': 'available'} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:14 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Cloning volume cc94ab83-0b26-40ec-a0b9-b028bb6d6817 to volume 68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Creating offline snapshot 4d8de657-b419-43ff-872f-5b7d4a21fdad of volume cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177daf9-870f-4dcc-8962-9291fe852f5f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:14 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 Sep 09 14:46:14 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:15 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" returned: 0 in 0.480s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:15 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad 1G Sep 09 14:46:15 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:15 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad 1G" returned: 0 in 0.601s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:15 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad Sep 09 14:46:15 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:16 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad" returned: 0 in 0.335s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:16 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad is being set with open permissions: ugo+rw Sep 09 14:46:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:16 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad Sep 09 14:46:16 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:16 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad" returned: 0 in 0.312s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:16 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info Sep 09 14:46:16 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:16 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:16 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info is being set with open permissions: ugo+rw Sep 09 14:46:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:16 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info Sep 09 14:46:16 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:17 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.info" returned: 0 in 0.324s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Acquiring lock "cinder-quobyte-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] snapshot: 4d8de657-b419-43ff-872f-5b7d4a21fdad, volume: 68b07d1c-9c21-4fa1-bcf5-d272c69b02c6, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1499644a-7de8-4287-b60b-855b16fb5cf1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:17 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad Sep 09 14:46:17 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:17 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad" returned: 0 in 0.617s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d353cbb-f89a-4e92-97f9-623605e0b835]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:17 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 Sep 09 14:46:17 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:18 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" returned: 0 in 0.505s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:46:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:46:18 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:46:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:18 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 Sep 09 14:46:18 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "cinder-71e9c5af-3a0a-4b9f-a442-f9457a339876-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-71e9c5af-3a0a-4b9f-a442-f9457a339876-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "cinder-quobyte-71e9c5af-3a0a-4b9f-a442-f9457a339876" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-quobyte-71e9c5af-3a0a-4b9f-a442-f9457a339876" acquired by "delete_volume" :: waited 0.053s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4374e-f6da-4835-ae17-55f3792f49a8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:23 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 Sep 09 14:46:23 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:24 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876" returned: 0 in 0.721s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:24 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876 Sep 09 14:46:24 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:24 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" returned: 0 in 5.884s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:46:24 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Converted 1024.00 MB image at 173.94 MB/s Sep 09 14:46:24 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 is being set with open permissions: ugo+rw Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:24 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 Sep 09 14:46:24 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:24 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" returned: 0 in 0.362s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" released by "_copy_volume_from_snapshot" :: held 7.470s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:24 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71e9c5af-3a0a-4b9f-a442-f9457a339876" returned: 0 in 0.483s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Acquiring lock "cinder-quobyte-4d8de657-b419-43ff-872f-5b7d4a21fdad" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-quobyte-71e9c5af-3a0a-4b9f-a442-f9457a339876" released by "delete_volume" :: held 1.347s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-4d8de657-b419-43ff-872f-5b7d4a21fdad" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Deleting offline snapshot 4d8de657-b419-43ff-872f-5b7d4a21fdad of volume cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] snapshot_file for this snap is: volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5182eba-dbd7-4d5f-a122-02940cf265d1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Created reservations ['1566bda2-1af6-4085-997d-f8d35fc1ced8', 'e5dde83c-596a-4a3f-bc4b-7267f2eab85e', '4e814db4-b00f-4959-bb8d-57915b3711e1', 'a06c1712-d13b-40e2-9d19-7b0a955d81a0'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:24 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad Sep 09 14:46:24 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:24 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:24 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:25 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Deleted volume successfully. Sep 09 14:46:25 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b73c57df-6d80-4604-a774-b0f5b2b010ea tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-71e9c5af-3a0a-4b9f-a442-f9457a339876-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad" returned: 0 in 0.651s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ed6ec7-bade-464c-ba96-90fcaedabdf8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:25 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 Sep 09 14:46:25 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "cinder-df77564c-e90a-4fa6-b930-53b52c0e97e0-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-df77564c-e90a-4fa6-b930-53b52c0e97e0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "cinder-quobyte-df77564c-e90a-4fa6-b930-53b52c0e97e0" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-quobyte-df77564c-e90a-4fa6-b930-53b52c0e97e0" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c324b-a196-4e8c-b452-c2ecc3781e08]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:26 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 Sep 09 14:46:26 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:26 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" returned: 0 in 1.005s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:26 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad Sep 09 14:46:26 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:26 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0" returned: 0 in 0.665s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:26 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0 Sep 09 14:46:26 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:26 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-df77564c-e90a-4fa6-b930-53b52c0e97e0" returned: 0 in 0.495s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-quobyte-df77564c-e90a-4fa6-b930-53b52c0e97e0" released by "delete_volume" :: held 1.272s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Created reservations ['f9c17a44-6c48-47e3-b5ad-203d420df7d5', '56809fdc-d045-4bc7-ba4d-07535e93676d', '4783c29a-fc3c-4dbd-8202-45e7df6e33d4', '07b7ff51-63f9-4438-8019-0656bac2e6fe'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:27 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad" returned: 0 in 0.791s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:27 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad Sep 09 14:46:27 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:27 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:27 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:27 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:27 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817.4d8de657-b419-43ff-872f-5b7d4a21fdad" returned: 0 in 0.436s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Deleted volume successfully. Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-4d8de657-b419-43ff-872f-5b7d4a21fdad" released by "_delete_snapshot" :: held 3.027s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1d74e699-29ca-41ce-a5d8-fb8f235c0276 tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-df77564c-e90a-4fa6-b930-53b52c0e97e0-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.191s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8da20e-7254-4de0-8fd6-a42f7e19a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6', 'volume_size': 2, 'source_volid': 'cc94ab83-0b26-40ec-a0b9-b028bb6d6817', 'source_volstatus': 'available'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae253a3-8053-4ecf-9cba-b38f6ba57ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Volume volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 (68b07d1c-9c21-4fa1-bcf5-d272c69b02c6): created successfully Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae253a3-8053-4ecf-9cba-b38f6ba57ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Flow 'volume_create_manager' (7713d3ac-d911-4696-89a0-a218f052489d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0d66ca70-c67c-4779-abe6-e2430a39a71a tempest-VolumesCloneTest-1957624502 None] Created volume successfully. Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "cinder-d701183d-530f-4a05-82ab-0d1301b0a415-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-d701183d-530f-4a05-82ab-0d1301b0a415-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "cinder-quobyte-d701183d-530f-4a05-82ab-0d1301b0a415" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-quobyte-d701183d-530f-4a05-82ab-0d1301b0a415" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664d99f-5eab-421e-a2a7-247fdb6933f6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:28 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 Sep 09 14:46:28 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Acquiring lock "cinder-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Lock "cinder-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Acquiring lock "cinder-quobyte-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96056a-b516-4f5e-aee2-129f3dd159dd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:28 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415" returned: 0 in 0.486s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:28 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415 Sep 09 14:46:28 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:28 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 Sep 09 14:46:28 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:28 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d701183d-530f-4a05-82ab-0d1301b0a415" returned: 0 in 0.349s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-quobyte-d701183d-530f-4a05-82ab-0d1301b0a415" released by "delete_volume" :: held 0.901s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Created reservations ['eeba0646-aabe-435a-8876-2499a5de6832', '94a107cf-c9f8-4bfb-bca4-f44840319aa2', '773b761c-1daa-4499-af30-826e0c138be0', 'de1c44d7-8d83-452c-9c1e-5d44a983f4b0'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:29 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" returned: 0 in 0.510s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:29 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6 Sep 09 14:46:29 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:29 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:29 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:29 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" returned: 0 in 0.324s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:29 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6" released by "delete_volume" :: held 0.878s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Deleted volume successfully. Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Created reservations ['b58ea2aa-f25e-45dc-8441-ec5385b68d13', 'f2544748-482b-439a-a4ae-3cbc6c82e333', '409f0d36-3b8d-4f79-9049-dad01159a183', 'e01d8f24-2e82-432e-ac0e-40dfee509d3e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d221d6f-d77d-48ad-95fe-ec14832388cd tempest-AttachVolumeTestJSON-1925831657 None] Lock "cinder-d701183d-530f-4a05-82ab-0d1301b0a415-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:29 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:29 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:30 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:30 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Deleted volume successfully. Sep 09 14:46:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f0009bb6-5967-47c3-a0d1-801d5dc41d98 tempest-VolumesCloneTest-1957624502 None] Lock "cinder-68b07d1c-9c21-4fa1-bcf5-d272c69b02c6-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-a7542d10-254a-4ea0-9792-dab035a385a8 req-17d876ae-cc93-417c-a1e5-207f895992e6 tempest-AttachVolumeShelveTestJSON-390536807 None] No connector for attachment 97105fb7-3bd0-4818-9156-22fdb0036f44; skipping storage backend terminate_connection call. {{(pid=87325) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 09 14:46:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-a7542d10-254a-4ea0-9792-dab035a385a8 req-17d876ae-cc93-417c-a1e5-207f895992e6 tempest-AttachVolumeShelveTestJSON-390536807 None] Deleting attachment 97105fb7-3bd0-4818-9156-22fdb0036f44. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Acquiring lock "cinder-cc94ab83-0b26-40ec-a0b9-b028bb6d6817-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Lock "cinder-cc94ab83-0b26-40ec-a0b9-b028bb6d6817-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Acquiring lock "cinder-quobyte-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c6b3c-dc9b-4912-9d3b-1d8cbb483c61]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:31 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 Sep 09 14:46:31 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:31 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" returned: 0 in 0.367s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:31 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817 Sep 09 14:46:31 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:32 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" returned: 0 in 0.258s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Lock "cinder-quobyte-cc94ab83-0b26-40ec-a0b9-b028bb6d6817" released by "delete_volume" :: held 0.686s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Created reservations ['82130fd0-4f73-4173-adec-56ccead02e53', 'f2ba6891-df21-4e68-a5d5-6aa27c882acd', '7959a1c9-2c9f-4ec2-9c97-abc2ae3993d4', '175cdaf0-8681-46ee-8c51-30a0b05fe176'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:32 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:32 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:33 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:33 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Deleted volume successfully. Sep 09 14:46:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf72d675-e39f-44bb-83ab-606761d1cd0b tempest-VolumesCloneTest-1957624502 None] Lock "cinder-cc94ab83-0b26-40ec-a0b9-b028bb6d6817-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Flow 'volume_create_manager' (d7e46779-b3ad-456f-bb4c-206600a576e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faea32e6-a046-4e8c-a3f4-2ff767332005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faea32e6-a046-4e8c-a3f4-2ff767332005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-632885463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eceda21-025d-4407-bf07-fd15835af306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc063cd59a2401cbb994c77d3008ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:42Z,use_quota=True,user_id='9787a83ff85943dba61b34552cdd681a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d97485-eae5-40d1-b248-2efc81e8e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d97485-eae5-40d1-b248-2efc81e8e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aa903a-40c6-4c1a-a470-2b407dea5a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aa903a-40c6-4c1a-a470-2b407dea5a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3eceda21-025d-4407-bf07-fd15835af306', 'volume_name': 'volume-3eceda21-025d-4407-bf07-fd15835af306', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef51a79-13da-4232-a97b-245775cfe6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef51a79-13da-4232-a97b-245775cfe6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a20801-b6d1-40bc-94d2-fcbe29fbcf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Volume 3eceda21-025d-4407-bf07-fd15835af306: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3eceda21-025d-4407-bf07-fd15835af306', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 14:46:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Trying to clone 3eceda21-025d-4407-bf07-fd15835af306 from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:46:43 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:46:43 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Image download 20.69 MB at 20.69 MB/s Sep 09 14:46:43 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef2fb9-32ec-4a92-96b1-942664acef90]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:43 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD Sep 09 14:46:43 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:43 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:43 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 is fetched for user 9787a83ff85943dba61b34552cdd681a. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec7440-7f75-4783-89a1-9ac985e00893]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:44 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD Sep 09 14:46:44 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:44 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-632885463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eceda21-025d-4407-bf07-fd15835af306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc063cd59a2401cbb994c77d3008ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:42Z,use_quota=True,user_id='9787a83ff85943dba61b34552cdd681a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Creating volume 3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:44 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:44 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 1073741824 Sep 09 14:46:44 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:45 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 1073741824" returned: 0 in 0.735s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=73,cinder:UPDATE=93,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:45 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 Sep 09 14:46:45 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:45 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306" returned: 0 in 0.345s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Attempting download of 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume 3eceda21-025d-4407-bf07-fd15835af306. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee061762-9b50-42b1-aff9-4d14587bfc4a]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:46 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd Sep 09 14:46:46 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:46 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd" returned: 0 in 0.394s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:46 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd Sep 09 14:46:46 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:46 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd" returned: 1 in 0.414s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_2ql5jpbd' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:46:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84cad29-d01e-4200-a4a6-db9305d04c0c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:46 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD Sep 09 14:46:46 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:47 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:47 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] 0dcaa084-c738-4c9b-8211-0cc749ab59f6 was qcow2, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:46:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:47 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 Sep 09 14:46:47 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:49 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306" returned: 0 in 2.643s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:49 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_vvpq14npdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:46:49 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Converted 112.00 MB image at 42.35 MB/s Sep 09 14:46:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:49 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 1G Sep 09 14:46:49 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:50 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 1G" returned: 0 in 0.772s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Downloaded image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume 3eceda21-025d-4407-bf07-fd15835af306 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 for user 9787a83ff85943dba61b34552cdd681a is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Marking volume 3eceda21-025d-4407-bf07-fd15835af306 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Copying metadata from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 to 3eceda21-025d-4407-bf07-fd15835af306. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Creating volume glance metadata for volume 3eceda21-025d-4407-bf07-fd15835af306 backed by image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Flow 'volume_create_manager' (da5ae10d-c459-4066-bd53-f13c7c73334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d98af76-f781-4891-a4a9-fe83c01326eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e8477b84-2a13-48f3-a470-3f96ee004b63 tempest-GroupSnapshotsTest-1434934899 None] Group tempest-GroupSnapshotsTest-Group-289791166: creating Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d98af76-f781-4891-a4a9-fe83c01326eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1288468532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dec666-2dfe-4482-a625-aba10da906b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8032092df1cf4dd0b002947d004b0b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:51Z,use_quota=True,user_id='2a7f24305e6743b5a90f1cad172e03a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28e089a-afea-4918-8320-45d4feea6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28e089a-afea-4918-8320-45d4feea6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee6440e-26a5-4173-bd95-9cca49d5bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee6440e-26a5-4173-bd95-9cca49d5bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dec666-2dfe-4482-a625-aba10da906b7', 'volume_name': 'volume-d0dec666-2dfe-4482-a625-aba10da906b7', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40aa2670-92e7-42fc-ab0a-bc471eb99125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40aa2670-92e7-42fc-ab0a-bc471eb99125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16fed98-8d39-4ca3-b564-b5eb5b7c2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Volume d0dec666-2dfe-4482-a625-aba10da906b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dec666-2dfe-4482-a625-aba10da906b7', 'volume_size': 1} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1288468532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dec666-2dfe-4482-a625-aba10da906b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8032092df1cf4dd0b002947d004b0b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:51Z,use_quota=True,user_id='2a7f24305e6743b5a90f1cad172e03a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Creating volume d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:50 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a20801-b6d1-40bc-94d2-fcbe29fbcf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eceda21-025d-4407-bf07-fd15835af306', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:50 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 1073741824 Sep 09 14:46:50 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ca0982-474a-4536-8e4d-facb3e29b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Volume volume-3eceda21-025d-4407-bf07-fd15835af306 (3eceda21-025d-4407-bf07-fd15835af306): created successfully Sep 09 14:46:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ca0982-474a-4536-8e4d-facb3e29b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Flow 'volume_create_manager' (d7e46779-b3ad-456f-bb4c-206600a576e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e8477b84-2a13-48f3-a470-3f96ee004b63 tempest-GroupSnapshotsTest-1434934899 None] Group tempest-GroupSnapshotsTest-Group-289791166: created successfully Sep 09 14:46:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-73daccf5-59c1-4e38-9d60-06e732547286 tempest-VolumesExtendTest-1375857149 None] Created volume successfully. Sep 09 14:46:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e8477b84-2a13-48f3-a470-3f96ee004b63 tempest-GroupSnapshotsTest-1434934899 None] Create group completed successfully. Sep 09 14:46:51 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 1073741824" returned: 0 in 0.849s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:52 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 Sep 09 14:46:52 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:52 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:52 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:52 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7" returned: 0 in 0.890s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:52 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.432s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.561s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14effa6-6102-429b-8b21-106657a16320]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16fed98-8d39-4ca3-b564-b5eb5b7c2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dec666-2dfe-4482-a625-aba10da906b7', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179ad107-5903-4ee3-9849-3ef65cd6e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Volume volume-d0dec666-2dfe-4482-a625-aba10da906b7 (d0dec666-2dfe-4482-a625-aba10da906b7): created successfully Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179ad107-5903-4ee3-9849-3ef65cd6e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Flow 'volume_create_manager' (da5ae10d-c459-4066-bd53-f13c7c73334a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-68f94388-1129-4635-b66a-03ec15f55ac0 tempest-TestStampPattern-1011391749 None] Created volume successfully. Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:53 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 Sep 09 14:46:53 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (c9425f60-77f4-4647-8e0f-521ad8c2691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cf29dc-3bfe-40ad-b311-8f6a1a734fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cf29dc-3bfe-40ad-b311-8f6a1a734fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53208554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d3f4794-833b-41e0-aa3b-444d9660a6c6,host='devstack@QuobyteHD#QuobyteHD',id=917e2621-e497-446e-81f9-84c7510f1efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:53Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad2082a-227c-4864-8b73-6384b6206f1e),volume_type_id=8ad2082a-227c-4864-8b73-6384b6206f1e)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad324134-8fdd-421f-9da2-6be590d27b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad324134-8fdd-421f-9da2-6be590d27b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd9054c-7628-4c8b-9cc7-d8ea55e24414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd9054c-7628-4c8b-9cc7-d8ea55e24414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917e2621-e497-446e-81f9-84c7510f1efb', 'volume_name': 'volume-917e2621-e497-446e-81f9-84c7510f1efb', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d37cd4-26af-4999-91a0-f9147c306d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d37cd4-26af-4999-91a0-f9147c306d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3451e-3519-47a9-b9f9-e8b666f157e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Volume 917e2621-e497-446e-81f9-84c7510f1efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917e2621-e497-446e-81f9-84c7510f1efb', 'volume_size': 1} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:53 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306" returned: 0 in 0.565s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 2G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 2G" returned: 0 in 0.162s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.798s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d3f4794-833b-41e0-aa3b-444d9660a6c6,created_at=2026-09-09T12:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53208554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d3f4794-833b-41e0-aa3b-444d9660a6c6,host='devstack@QuobyteHD#QuobyteHD',id=917e2621-e497-446e-81f9-84c7510f1efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:53Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad2082a-227c-4864-8b73-6384b6206f1e),volume_type_id=8ad2082a-227c-4864-8b73-6384b6206f1e)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Creating volume 917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:53 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:53 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb 1073741824 Sep 09 14:46:53 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-15bc0ed8-506d-4bbf-bb4a-8985e116fff7 tempest-VolumesExtendTest-1375857149 None] Extend volume completed successfully. Sep 09 14:46:54 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb 1073741824" returned: 0 in 0.592s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:54 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb Sep 09 14:46:54 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:54 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3451e-3519-47a9-b9f9-e8b666f157e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917e2621-e497-446e-81f9-84c7510f1efb', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed70e80-89ac-477a-945f-f5397f478029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:54 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Volume volume-917e2621-e497-446e-81f9-84c7510f1efb (917e2621-e497-446e-81f9-84c7510f1efb): created successfully Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed70e80-89ac-477a-945f-f5397f478029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (c9425f60-77f4-4647-8e0f-521ad8c2691a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:54 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-557f5245-fda0-4d6d-9614-6482f2863f6d tempest-GroupSnapshotsTest-1434934899 None] Created volume successfully. Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-3eceda21-025d-4407-bf07-fd15835af306-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Lock "cinder-3eceda21-025d-4407-bf07-fd15835af306-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-quobyte-3eceda21-025d-4407-bf07-fd15835af306" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-3eceda21-025d-4407-bf07-fd15835af306" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[348bba35-ebad-4ef9-8f2f-f57f93466e9b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:55 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 Sep 09 14:46:55 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:55 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306" returned: 0 in 0.550s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:55 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306 Sep 09 14:46:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] GroupSnapshot 1346d175-956a-47dd-b4aa-5e14158da9a5: creating. Sep 09 14:46:55 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=100,cinder:SELECT=98,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:46:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Group snapshot 1346d175-956a-47dd-b4aa-5e14158da9a5: creating. {{(pid=87325) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Creating offline snapshot ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 of volume 917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[739bac61-d0b2-4955-b878-f6e31db11266]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:56 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3eceda21-025d-4407-bf07-fd15835af306" returned: 0 in 0.361s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:56 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb Sep 09 14:46:56 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-3eceda21-025d-4407-bf07-fd15835af306" released by "delete_volume" :: held 0.983s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Created reservations ['e9157b8b-cc76-40f3-9d2c-1f8f43ee5573', 'e69c840a-e2c3-458e-9952-8df66c5577b7', '2a801762-38c0-4710-ad51-fe1c6939024d', 'e5a5699d-2c97-43c6-b38c-c8543a831d19'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:56 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:46:56 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:56 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb" returned: 0 in 0.550s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:56 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 1G Sep 09 14:46:56 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:56 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:46:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Deleted volume successfully. Sep 09 14:46:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e1675711-bc5a-4dd1-b86a-65d8e8532e5e tempest-VolumesExtendTest-1375857149 None] Lock "cinder-3eceda21-025d-4407-bf07-fd15835af306-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:46:57 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 1G" returned: 0 in 0.591s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e2621-e497-446e-81f9-84c7510f1efb -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:57 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e2621-e497-446e-81f9-84c7510f1efb -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 Sep 09 14:46:57 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:57 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917e2621-e497-446e-81f9-84c7510f1efb -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:57 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:46:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:57 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 Sep 09 14:46:57 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:58 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" returned: 0 in 0.601s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:58 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info Sep 09 14:46:58 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:46:59 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Flow 'volume_create_manager' (ed335273-2c72-4902-96a0-437594f0152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184d20d4-5b62-4875-9bc9-7f946e5eb3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info" returned: 0 in 0.979s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:59 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184d20d4-5b62-4875-9bc9-7f946e5eb3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1167940906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743ed9c6-62eb-4081-ad96-e3d1994cc13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc063cd59a2401cbb994c77d3008ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:59Z,use_quota=True,user_id='9787a83ff85943dba61b34552cdd681a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:59 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info Sep 09 14:46:59 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b8f77b-6910-4155-b607-16aa2f5bf7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b8f77b-6910-4155-b607-16aa2f5bf7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20729b88-1361-4136-9c13-0711eecb76c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20729b88-1361-4136-9c13-0711eecb76c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743ed9c6-62eb-4081-ad96-e3d1994cc13e', 'volume_name': 'volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878dca6d-7f7f-4558-bd8f-9d12957b7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878dca6d-7f7f-4558-bd8f-9d12957b7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c657ab4-fdfa-4a28-98a3-fdf59a6ed064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:46:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Volume 743ed9c6-62eb-4081-ad96-e3d1994cc13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e', 'volume_size': 1} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:59 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.info" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.801s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1167940906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743ed9c6-62eb-4081-ad96-e3d1994cc13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc063cd59a2401cbb994c77d3008ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:46:59Z,use_quota=True,user_id='9787a83ff85943dba61b34552cdd681a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Creating volume 743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:46:59 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:46:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:46:59 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e 1073741824 Sep 09 14:46:59 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:46:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1dafadf2-d6f5-425b-82c0-0c81c5605c48 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 1346d175-956a-47dd-b4aa-5e14158da9a5: created successfully Sep 09 14:47:00 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e 1073741824" returned: 0 in 0.722s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:00 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e Sep 09 14:47:00 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:01 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e" returned: 0 in 0.414s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c657ab4-fdfa-4a28-98a3-fdf59a6ed064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f008f694-f44c-47db-a791-ec0ee0534c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:01 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Volume volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e (743ed9c6-62eb-4081-ad96-e3d1994cc13e): created successfully Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f008f694-f44c-47db-a791-ec0ee0534c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Flow 'volume_create_manager' (ed335273-2c72-4902-96a0-437594f0152f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5124f0f9-ba82-4654-a7c6-5277399366cf tempest-VolumesExtendTest-1375857149 None] Created volume successfully. Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4-8b220de8-acf2-4f09-9f6a-944b3545adcb" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4-8b220de8-acf2-4f09-9f6a-944b3545adcb" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Creating volume 8b220de8-acf2-4f09-9f6a-944b3545adcb from snapshot ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-8b220de8-acf2-4f09-9f6a-944b3545adcb" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-8b220de8-acf2-4f09-9f6a-944b3545adcb" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] snapshot: ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4, volume: 8b220de8-acf2-4f09-9f6a-944b3545adcb, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87690da-0ae1-4825-bf78-b43beddb3ddb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:01 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 Sep 09 14:47:01 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:02 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" returned: 0 in 0.653s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917e2621-e497-446e-81f9-84c7510f1efb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c33b613-9b63-4d69-bf79-f08edf648939]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:02 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb Sep 09 14:47:02 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:02 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb" returned: 0 in 0.687s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:47:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:03 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb Sep 09 14:47:03 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:08 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb" returned: 0 in 5.762s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:08 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:47:08 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Converted 1024.00 MB image at 177.69 MB/s Sep 09 14:47:08 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:08 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb Sep 09 14:47:08 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:09 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-8b220de8-acf2-4f09-9f6a-944b3545adcb" released by "_copy_volume_from_snapshot" :: held 7.575s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4-8b220de8-acf2-4f09-9f6a-944b3545adcb" released by "_create_volume_from_snapshot" :: held 7.696s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.739s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.552s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Creating offline snapshot c7ca8e30-8f9e-40e6-b347-8664ca5bd33a of volume 743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e6b62-7c3e-4c8c-9732-55d5c80288ea]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:09 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bf88c7f4-7d6c-459f-b3a7-224684e2640e tempest-GroupSnapshotsTest-1434934899 None] Create group from source-snapshot-1346d175-956a-47dd-b4aa-5e14158da9a5 completed successfully. Sep 09 14:47:09 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e Sep 09 14:47:09 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:09 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e" returned: 0 in 0.356s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:09 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a 1G Sep 09 14:47:09 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:09 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a 1G" returned: 0 in 0.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:09 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a Sep 09 14:47:09 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:10 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" returned: 0 in 0.316s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:10 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a is being set with open permissions: ugo+rw Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:10 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a Sep 09 14:47:10 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-8b220de8-acf2-4f09-9f6a-944b3545adcb" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-8b220de8-acf2-4f09-9f6a-944b3545adcb" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:10 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1905aedf-3f5b-4b4b-b367-5581b4d73a37]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:10 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info Sep 09 14:47:10 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:10 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb Sep 09 14:47:10 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:10 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info" returned: 0 in 0.333s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:10 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info is being set with open permissions: ugo+rw Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:10 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info Sep 09 14:47:10 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:10 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb" returned: 0 in 0.458s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:11 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb Sep 09 14:47:11 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:11 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.info" returned: 0 in 0.354s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:11 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8b220de8-acf2-4f09-9f6a-944b3545adcb" returned: 0 in 0.358s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ebb8f350-f5b7-4624-83f2-1b13da59abce tempest-VolumesExtendTest-1375857149 None] Create snapshot completed successfully Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-8b220de8-acf2-4f09-9f6a-944b3545adcb" released by "delete_volume" :: held 0.877s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['12d9b20e-ce40-44b6-8caf-329a8e128208'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:11 devstack cinder-volume[87325]: WARNING cinder.quota [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-543779229 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-543779229, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:11 devstack cinder-volume[87325]: WARNING cinder.quota [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-543779229 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-543779229, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['3f272ef3-f55a-4a0b-8a0d-61f7be8581b5', '1e94ef69-d4a6-4fb8-abba-a1e3b9b99e17', '4c6587b8-b117-40f9-9b07-87d7e74e865e', 'cdb796d8-5e2e-43be-b453-ba402857f64d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:11 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:11 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 1346d175-956a-47dd-b4aa-5e14158da9a5: deleting Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 1346d175-956a-47dd-b4aa-5e14158da9a5: deleting {{(pid=87325) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 14:47:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-917e2621-e497-446e-81f9-84c7510f1efb" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-917e2621-e497-446e-81f9-84c7510f1efb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Deleting offline snapshot ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 of volume 917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:12 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] snapshot_file for this snap is: volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.459s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-79cfd898-54f7-4e56-b431-aa8aa4d2cc22 tempest-GroupSnapshotsTest-1434934899 None] Delete group completed successfully. Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c359fd3-24c6-4429-ac99-10d40994c96f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:12 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 Sep 09 14:47:12 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9131ab25-ea0e-449d-acfc-ebf40b30bbbc]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:12 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e Sep 09 14:47:12 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:12 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" returned: 0 in 0.566s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917e2621-e497-446e-81f9-84c7510f1efb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbe0090-f67c-4d23-82da-2b0499c53f82]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:12 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb Sep 09 14:47:12 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:13 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e" returned: 0 in 0.670s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a 2G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a 2G" returned: 0 in 0.270s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.024s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b9eb08d4-38e8-471d-995e-5e1f03644089 tempest-VolumesExtendTest-1375857149 None] Extend volume completed successfully. Sep 09 14:47:13 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb" returned: 0 in 0.915s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:13 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 Sep 09 14:47:13 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-c7ca8e30-8f9e-40e6-b347-8664ca5bd33a-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-c7ca8e30-8f9e-40e6-b347-8664ca5bd33a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-quobyte-743ed9c6-62eb-4081-ad96-e3d1994cc13e" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-743ed9c6-62eb-4081-ad96-e3d1994cc13e" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-quobyte-c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Deleting offline snapshot c7ca8e30-8f9e-40e6-b347-8664ca5bd33a of volume 743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] snapshot_file for this snap is: volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf4de2-281b-4603-bc5a-a27440a5a63e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:14 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" returned: 0 in 0.641s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:14 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a Sep 09 14:47:14 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:14 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4 Sep 09 14:47:14 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:14 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb.ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" returned: 0 in 0.430s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-ee4d0a94-138f-44d0-b1c8-b8cd041bb4a4" released by "_delete_snapshot" :: held 2.691s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-917e2621-e497-446e-81f9-84c7510f1efb" released by "delete_snapshot" :: held 2.737s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:14 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" returned: 0 in 0.643s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fcc7c0-e1d0-4598-9a40-68ce15ea21d7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:14 devstack cinder-volume[87325]: WARNING cinder.quota [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-543779229 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-543779229, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:14 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['aa763327-46ff-4a93-bb7a-46f059ef058f', 'aaa26777-f389-4980-9f23-0628aa1bdfc2', '6891c041-416e-45a7-b182-d882f36452c1', 'cb9102e7-9605-4e32-b529-28cd59720e2d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:14 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e Sep 09 14:47:14 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:15 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-501b142c-92ff-4b73-b605-a92b7b7714d0 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 1346d175-956a-47dd-b4aa-5e14158da9a5: deleted successfully Sep 09 14:47:15 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:15 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a Sep 09 14:47:15 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:15 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" returned: 0 in 0.654s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:15 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a Sep 09 14:47:15 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-917e2621-e497-446e-81f9-84c7510f1efb" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-917e2621-e497-446e-81f9-84c7510f1efb" acquired by "delete_volume" :: waited 0.050s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94878c-d49e-40bb-aa0d-463f17c28cf6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:16 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb Sep 09 14:47:16 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:16 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e.c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" returned: 0 in 0.363s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-c7ca8e30-8f9e-40e6-b347-8664ca5bd33a" released by "_delete_snapshot" :: held 2.244s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-743ed9c6-62eb-4081-ad96-e3d1994cc13e" released by "delete_snapshot" :: held 2.279s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Created reservations ['1dbe77ea-ffdc-48dc-b9f8-ecf97607d11e', '97693cad-510e-4b1b-aafd-3ba8435cb167', '1caeac43-9ecd-43c8-93e9-139f3a24c757', '74374edf-1d33-432c-9393-38f984c97c32'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Delete snapshot completed successfully. Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-57d02723-0ca8-4a36-9b69-c5e3cf3626a2 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-c7ca8e30-8f9e-40e6-b347-8664ca5bd33a-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:16 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:16 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb Sep 09 14:47:16 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:16 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-917e2621-e497-446e-81f9-84c7510f1efb" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-917e2621-e497-446e-81f9-84c7510f1efb" released by "delete_volume" :: held 0.776s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['7d297e42-63dc-485c-a0c6-e90ca642c814'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Acquiring lock "cinder-65781205-1042-4dc1-8277-8e45d4bdc179-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:16 devstack cinder-volume[87325]: WARNING cinder.db.api [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-543779229'] Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['89740d4b-e347-48a0-b330-3a1b6cce62a2', '683f2817-44b8-4582-bee9-a843d1bf2e62', '58859436-76cc-40c6-bf23-633ae7494833', 'de75e238-3a86-432b-8366-30cba91a2790'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "cinder-65781205-1042-4dc1-8277-8e45d4bdc179-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Acquiring lock "cinder-quobyte-65781205-1042-4dc1-8277-8e45d4bdc179" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "cinder-quobyte-65781205-1042-4dc1-8277-8e45d4bdc179" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2f580-2588-4df2-a6c0-458785eb256f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:17 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:17 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:17 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 Sep 09 14:47:17 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-743ed9c6-62eb-4081-ad96-e3d1994cc13e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-743ed9c6-62eb-4081-ad96-e3d1994cc13e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "cinder-quobyte-743ed9c6-62eb-4081-ad96-e3d1994cc13e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-743ed9c6-62eb-4081-ad96-e3d1994cc13e" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:17 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.334s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-390dcd30-9140-4ce1-91f4-052c67707847 tempest-GroupSnapshotsTest-1434934899 None] Delete group completed successfully. Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c36fe9-1ff3-4565-a56d-3afa449b69e4]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:17 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:17 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179 Sep 09 14:47:17 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:17 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e Sep 09 14:47:17 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3ec79903-a18f-44d7-8436-c4da0b580bc5 tempest-GroupSnapshotsTest-1434934899 None] Group tempest-GroupSnapshotsTest-Group-999433415: creating Sep 09 14:47:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3ec79903-a18f-44d7-8436-c4da0b580bc5 tempest-GroupSnapshotsTest-1434934899 None] Group tempest-GroupSnapshotsTest-Group-999433415: created successfully Sep 09 14:47:17 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3ec79903-a18f-44d7-8436-c4da0b580bc5 tempest-GroupSnapshotsTest-1434934899 None] Create group completed successfully. Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-65781205-1042-4dc1-8277-8e45d4bdc179" returned: 0 in 0.264s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "cinder-quobyte-65781205-1042-4dc1-8277-8e45d4bdc179" released by "delete_volume" :: held 0.752s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Created reservations ['0700ce74-0924-4c61-ad63-4262aee21bec', '4d8dc888-1ad6-4686-9ae2-3d2a5cd94901', '706ca605-276c-4641-badc-b23956ec588b', '32f7ee30-8e11-4473-a73f-7d2dd3d8e509'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:17 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e" returned: 0 in 0.391s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:17 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e Sep 09 14:47:17 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:17 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:17 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:18 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-743ed9c6-62eb-4081-ad96-e3d1994cc13e" returned: 0 in 0.263s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-quobyte-743ed9c6-62eb-4081-ad96-e3d1994cc13e" released by "delete_volume" :: held 0.739s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:18 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.274s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Deleted volume successfully. Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Created reservations ['75c27331-fa11-4823-b4b6-807c1f7a19f7', '8a729a9f-15c6-48a0-aac8-95064dac050b', 'c917f6c9-db6f-4823-bcd3-4424c60e1356', '1ce7e92d-9e4e-499f-89ad-a685261749cf'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-432ec3ff-b675-4723-83f4-b4778e73637c tempest-AttachVolumeShelveTestJSON-390536807 None] Lock "cinder-65781205-1042-4dc1-8277-8e45d4bdc179-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:18 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:18 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:18 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.266s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Deleted volume successfully. Sep 09 14:47:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a355234-b2ba-43ee-ab62-de50932aa8e7 tempest-VolumesExtendTest-1375857149 None] Lock "cinder-743ed9c6-62eb-4081-ad96-e3d1994cc13e-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (79e72d04-dc56-43e4-a5ab-7011611c47e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a379593b-5ba7-4d2d-919d-6c1d33ccd7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a379593b-5ba7-4d2d-919d-6c1d33ccd7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1362428179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb042cd-3c04-4391-854b-ecc8c6eaca0b,host='devstack@QuobyteHD#QuobyteHD',id=31df05a2-0c70-4b68-be4d-5aec68289a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:19Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dbe9afa-851c-4f61-b861-790a2c2f1bdd),volume_type_id=2dbe9afa-851c-4f61-b861-790a2c2f1bdd)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f5b909-e97c-40e3-b2fe-4fcdf3929aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f5b909-e97c-40e3-b2fe-4fcdf3929aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe2802f-ab68-4916-876e-b6abd773928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe2802f-ab68-4916-876e-b6abd773928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31df05a2-0c70-4b68-be4d-5aec68289a7f', 'volume_name': 'volume-31df05a2-0c70-4b68-be4d-5aec68289a7f', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f3eca3-95b5-4e8c-8e76-51b4d51a4eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f3eca3-95b5-4e8c-8e76-51b4d51a4eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b16a80-3472-4edf-8627-0d575a847eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Volume 31df05a2-0c70-4b68-be4d-5aec68289a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31df05a2-0c70-4b68-be4d-5aec68289a7f', 'volume_size': 1} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cb042cd-3c04-4391-854b-ecc8c6eaca0b,created_at=2026-09-09T12:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1362428179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb042cd-3c04-4391-854b-ecc8c6eaca0b,host='devstack@QuobyteHD#QuobyteHD',id=31df05a2-0c70-4b68-be4d-5aec68289a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:19Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dbe9afa-851c-4f61-b861-790a2c2f1bdd),volume_type_id=2dbe9afa-851c-4f61-b861-790a2c2f1bdd)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Creating volume 31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:19 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:47:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:19 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f 1073741824 Sep 09 14:47:19 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:20 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f 1073741824" returned: 0 in 0.501s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:20 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f Sep 09 14:47:20 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:20 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f" returned: 0 in 0.300s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b16a80-3472-4edf-8627-0d575a847eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31df05a2-0c70-4b68-be4d-5aec68289a7f', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934d8131-a646-450f-9dbc-1f8cd3342574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:20 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Volume volume-31df05a2-0c70-4b68-be4d-5aec68289a7f (31df05a2-0c70-4b68-be4d-5aec68289a7f): created successfully Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934d8131-a646-450f-9dbc-1f8cd3342574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (79e72d04-dc56-43e4-a5ab-7011611c47e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-674b4823-df1d-4e79-b696-0b5e7cb1f67f tempest-GroupSnapshotsTest-1434934899 None] Created volume successfully. Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (47e0ab9e-33de-4340-b3bf-fa6796041ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218081c0-cb3f-4acc-bf1a-a9e4f241b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218081c0-cb3f-4acc-bf1a-a9e4f241b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300178743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb042cd-3c04-4391-854b-ecc8c6eaca0b,host='devstack@QuobyteHD#QuobyteHD',id=e7bcd849-bd7b-4197-90f4-f05263307eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:21Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dbe9afa-851c-4f61-b861-790a2c2f1bdd),volume_type_id=2dbe9afa-851c-4f61-b861-790a2c2f1bdd)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ac67e8-3176-43ea-8252-a8225cf80196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ac67e8-3176-43ea-8252-a8225cf80196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe6b00d-8ad3-4c36-8518-dc8d7209432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe6b00d-8ad3-4c36-8518-dc8d7209432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bcd849-bd7b-4197-90f4-f05263307eec', 'volume_name': 'volume-e7bcd849-bd7b-4197-90f4-f05263307eec', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdaba51-f3dc-4cd9-b6eb-7b3579028d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdaba51-f3dc-4cd9-b6eb-7b3579028d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce6e567-8c8a-47c0-8516-acb1e9d203e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Volume e7bcd849-bd7b-4197-90f4-f05263307eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bcd849-bd7b-4197-90f4-f05263307eec', 'volume_size': 1} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cb042cd-3c04-4391-854b-ecc8c6eaca0b,created_at=2026-09-09T12:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300178743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb042cd-3c04-4391-854b-ecc8c6eaca0b,host='devstack@QuobyteHD#QuobyteHD',id=e7bcd849-bd7b-4197-90f4-f05263307eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:21Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dbe9afa-851c-4f61-b861-790a2c2f1bdd),volume_type_id=2dbe9afa-851c-4f61-b861-790a2c2f1bdd)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Creating volume e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:21 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:47:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:21 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec 1073741824 Sep 09 14:47:21 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:22 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec 1073741824" returned: 0 in 0.597s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:22 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec Sep 09 14:47:22 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:22 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec" returned: 0 in 0.288s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce6e567-8c8a-47c0-8516-acb1e9d203e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bcd849-bd7b-4197-90f4-f05263307eec', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd34fda-eab5-4903-ac6a-9e61dd370be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Volume volume-e7bcd849-bd7b-4197-90f4-f05263307eec (e7bcd849-bd7b-4197-90f4-f05263307eec): created successfully Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd34fda-eab5-4903-ac6a-9e61dd370be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (47e0ab9e-33de-4340-b3bf-fa6796041ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-101e304b-c69a-4c79-93e0-93424ea00426 tempest-GroupSnapshotsTest-1434934899 None] Created volume successfully. Sep 09 14:47:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f07d940b-d558-4f60-91f8-3e5079b8807e tempest-GroupSnapshotsTest-1434934899 None] Update group completed successfully. Sep 09 14:47:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0847bd5f-a8dc-4f5e-b399-f10bd77e3392 tempest-GroupSnapshotsTest-1434934899 None] Update group completed successfully. Sep 09 14:47:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-373071f9-aefa-4afa-a11d-dbb0f88388ff tempest-GroupSnapshotsTest-1434934899 None] Update group completed successfully. Sep 09 14:47:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9d39b3c2-1aff-4d61-bdf0-5dec9e4aba56 tempest-GroupSnapshotsTest-1434934899 None] Update group completed successfully. Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Flow 'volume_create_manager' (acbdc77e-1dea-41ad-8d14-e57dd0e79832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9b9de9-0bc3-43d5-930b-a1e7d5acdea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9b9de9-0bc3-43d5-930b-a1e7d5acdea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-582933429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efeea0e-3f7c-4100-94a2-aed019bea650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762a77e5b5f848098f50256def886902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:27Z,use_quota=True,user_id='5d2c0c16ee764d12afa4fc24ac6ad58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240464cf-90b6-4c14-914c-fde5f6e8824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240464cf-90b6-4c14-914c-fde5f6e8824e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a7829f-97a2-44b6-9597-087be8bf9193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a7829f-97a2-44b6-9597-087be8bf9193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efeea0e-3f7c-4100-94a2-aed019bea650', 'volume_name': 'volume-4efeea0e-3f7c-4100-94a2-aed019bea650', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83bb9e-f0a6-43cc-ba48-f99b3808ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83bb9e-f0a6-43cc-ba48-f99b3808ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb0b3f0-fc45-4149-80a1-def24d179701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Volume 4efeea0e-3f7c-4100-94a2-aed019bea650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efeea0e-3f7c-4100-94a2-aed019bea650', 'volume_size': 1} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-582933429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efeea0e-3f7c-4100-94a2-aed019bea650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762a77e5b5f848098f50256def886902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:27Z,use_quota=True,user_id='5d2c0c16ee764d12afa4fc24ac6ad58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Creating volume 4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:27 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:27 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 1073741824 Sep 09 14:47:27 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Flow 'volume_create_manager' (a138b760-4253-4a3f-a85f-2bdf4e89544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d45f36-b517-415c-b84e-d31407f4e78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d45f36-b517-415c-b84e-d31407f4e78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-930055987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a25a9e-0422-488f-9c6b-138f023e6b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1adc1d8e49279c426cdd534d0753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:27Z,use_quota=True,user_id='192c1e4eef464cc89f885a7838b98fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8071d8e-69e0-48c2-876e-ab3e4fc46d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8071d8e-69e0-48c2-876e-ab3e4fc46d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e7c168-1e23-48a9-bfa5-5036f3a10714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e7c168-1e23-48a9-bfa5-5036f3a10714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a25a9e-0422-488f-9c6b-138f023e6b28', 'volume_name': 'volume-09a25a9e-0422-488f-9c6b-138f023e6b28', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b66dd25-b8d6-44d3-9e02-2b3778036147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b66dd25-b8d6-44d3-9e02-2b3778036147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ebcaf5-5203-4327-a0ea-7b698d897b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Volume 09a25a9e-0422-488f-9c6b-138f023e6b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a25a9e-0422-488f-9c6b-138f023e6b28', 'volume_size': 1} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:27 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 1073741824" returned: 0 in 0.466s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:27 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 Sep 09 14:47:27 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-0f9d28a3-8782-4a0b-a66a-8c7142c7d21d req-69018741-0b79-4e4a-89f9-453b7f5d3118 tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:27 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650" returned: 0 in 0.305s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-930055987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a25a9e-0422-488f-9c6b-138f023e6b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1adc1d8e49279c426cdd534d0753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:27Z,use_quota=True,user_id='192c1e4eef464cc89f885a7838b98fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Creating volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:27 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb0b3f0-fc45-4149-80a1-def24d179701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efeea0e-3f7c-4100-94a2-aed019bea650', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d16476-8167-4c4d-aaa8-fbdaa696f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:28 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 1073741824 Sep 09 14:47:28 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:28 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Volume volume-4efeea0e-3f7c-4100-94a2-aed019bea650 (4efeea0e-3f7c-4100-94a2-aed019bea650): created successfully Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d16476-8167-4c4d-aaa8-fbdaa696f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Flow 'volume_create_manager' (acbdc77e-1dea-41ad-8d14-e57dd0e79832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-13c9b896-f23e-481a-b503-976122931ecf req-fc022c98-d6be-4256-bc4e-a6d7da037d22 tempest-VolumesSnapshotsTestJSON-1083925804 None] Created volume successfully. Sep 09 14:47:28 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 1073741824" returned: 0 in 0.485s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:28 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 Sep 09 14:47:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] GroupSnapshot 890734c2-ed25-4272-984d-06124d60bd60: creating. Sep 09 14:47:28 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Group snapshot 890734c2-ed25-4272-984d-06124d60bd60: creating. {{(pid=87325) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:28 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28" returned: 0 in 0.247s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-0f9d28a3-8782-4a0b-a66a-8c7142c7d21d req-69018741-0b79-4e4a-89f9-453b7f5d3118 tempest-TestStampPattern-1011391749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.877s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ebcaf5-5203-4327-a0ea-7b698d897b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a25a9e-0422-488f-9c6b-138f023e6b28', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead052b-ba6c-4f07-a27f-8e539c20e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-0f9d28a3-8782-4a0b-a66a-8c7142c7d21d req-69018741-0b79-4e4a-89f9-453b7f5d3118 tempest-TestStampPattern-1011391749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.221s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:28 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Volume volume-09a25a9e-0422-488f-9c6b-138f023e6b28 (09a25a9e-0422-488f-9c6b-138f023e6b28): created successfully Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead052b-ba6c-4f07-a27f-8e539c20e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Flow 'volume_create_manager' (a138b760-4253-4a3f-a85f-2bdf4e89544c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Creating offline snapshot 9c86c21f-e223-4e61-9c66-14148c1bad60 of volume 31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b39171eb-8527-4fd3-8663-860818385055 tempest-VolumesSnapshotListTestJSON-2094745919 None] Created volume successfully. Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[62218c32-ba2e-42f1-af38-df85fc92c1bd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-0f9d28a3-8782-4a0b-a66a-8c7142c7d21d req-69018741-0b79-4e4a-89f9-453b7f5d3118 tempest-TestStampPattern-1011391749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-d0dec666-2dfe-4482-a625-aba10da906b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c4d4aad-2a44-46fe-bd17-80a8092aaa51', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:47:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-0f9d28a3-8782-4a0b-a66a-8c7142c7d21d req-69018741-0b79-4e4a-89f9-453b7f5d3118 tempest-TestStampPattern-1011391749 None] attachment_update completed successfully. Sep 09 14:47:28 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f Sep 09 14:47:28 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:29 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f" returned: 0 in 0.474s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:29 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 1G Sep 09 14:47:29 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:29 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 1G" returned: 0 in 0.535s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31df05a2-0c70-4b68-be4d-5aec68289a7f -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:29 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31df05a2-0c70-4b68-be4d-5aec68289a7f -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 Sep 09 14:47:29 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:30 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31df05a2-0c70-4b68-be4d-5aec68289a7f -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:30 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:30 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 Sep 09 14:47:30 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:30 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:30 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info Sep 09 14:47:30 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:30 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info" returned: 0 in 0.244s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:30 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:30 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info Sep 09 14:47:30 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:30 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.info" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Creating offline snapshot ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 of volume e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c330c2-c2e7-4815-b21f-967bce07e340]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:31 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec Sep 09 14:47:31 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:31 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec" returned: 0 in 0.345s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:31 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 1G Sep 09 14:47:31 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:31 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 1G" returned: 0 in 0.414s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bcd849-bd7b-4197-90f4-f05263307eec -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:31 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bcd849-bd7b-4197-90f4-f05263307eec -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 Sep 09 14:47:31 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:32 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bcd849-bd7b-4197-90f4-f05263307eec -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:32 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:32 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 Sep 09 14:47:32 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:32 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" returned: 0 in 0.248s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:32 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info Sep 09 14:47:32 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:32 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info" returned: 0 in 0.246s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:32 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:32 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info Sep 09 14:47:32 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:32 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.info" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.389s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Creating offline snapshot feb04262-bcc5-4f24-a63a-0f7914e4a6c1 of volume 4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d4343-bb1d-4170-ba6a-8a39fc15a88c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0e50205f-dd22-411d-bcee-8b854b474d93 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 890734c2-ed25-4272-984d-06124d60bd60: created successfully Sep 09 14:47:33 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 Sep 09 14:47:33 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:33 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650" returned: 0 in 0.403s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:33 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 1G Sep 09 14:47:33 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:33 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 1G" returned: 0 in 0.448s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efeea0e-3f7c-4100-94a2-aed019bea650 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:33 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efeea0e-3f7c-4100-94a2-aed019bea650 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 Sep 09 14:47:33 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 890734c2-ed25-4272-984d-06124d60bd60: deleting Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 890734c2-ed25-4272-984d-06124d60bd60: deleting {{(pid=87325) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 14:47:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-dcef8e24-0b01-4793-80a9-92ce62e1bc89 req-ab6c6cf0-e77a-4873-baf1-9f5f44df311f tempest-TestStampPattern-1011391749 None] Terminate volume connection completed successfully. Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-dcef8e24-0b01-4793-80a9-92ce62e1bc89 req-ab6c6cf0-e77a-4873-baf1-9f5f44df311f tempest-TestStampPattern-1011391749 None] Deleting attachment 6c4d4aad-2a44-46fe-bd17-80a8092aaa51. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-31df05a2-0c70-4b68-be4d-5aec68289a7f" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-31df05a2-0c70-4b68-be4d-5aec68289a7f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-9c86c21f-e223-4e61-9c66-14148c1bad60" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-9c86c21f-e223-4e61-9c66-14148c1bad60" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Deleting offline snapshot 9c86c21f-e223-4e61-9c66-14148c1bad60 of volume 31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:34 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] snapshot_file for this snap is: volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efeea0e-3f7c-4100-94a2-aed019bea650 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1" returned: 0 in 0.379s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:34 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 is being set with open permissions: ugo+rw Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef14533-f9de-4efe-b40c-bf0cb7d428a9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:34 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 Sep 09 14:47:34 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:34 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 Sep 09 14:47:34 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:34 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:34 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info Sep 09 14:47:34 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:34 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60" returned: 0 in 0.429s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31df05a2-0c70-4b68-be4d-5aec68289a7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2096a0-50ac-4a9d-af96-5f07b156b118]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:34 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info" returned: 0 in 0.272s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:34 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info is being set with open permissions: ugo+rw Sep 09 14:47:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:34 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f Sep 09 14:47:34 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:34 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info Sep 09 14:47:34 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:35 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f" returned: 0 in 0.402s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:35 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.info" returned: 0 in 0.293s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:35 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:35 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.660s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Creating offline snapshot f2ac0f83-0214-40c7-839d-f0e7879e3733 of volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-1547a8c4-839f-4d13-add8-9b3c7f6b9ebf req-0716aea3-9349-4017-a2f3-10352f637880 tempest-VolumesSnapshotsTestJSON-1083925804 None] Create snapshot completed successfully Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b90f1-7867-403e-9959-134a5ae36b2d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:35 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 Sep 09 14:47:35 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:35 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "cinder-feb04262-bcc5-4f24-a63a-0f7914e4a6c1-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60" returned: 0 in 0.400s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-feb04262-bcc5-4f24-a63a-0f7914e4a6c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "cinder-quobyte-4efeea0e-3f7c-4100-94a2-aed019bea650" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:35 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60 Sep 09 14:47:35 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-quobyte-4efeea0e-3f7c-4100-94a2-aed019bea650" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "cinder-quobyte-feb04262-bcc5-4f24-a63a-0f7914e4a6c1" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-quobyte-feb04262-bcc5-4f24-a63a-0f7914e4a6c1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Deleting offline snapshot feb04262-bcc5-4f24-a63a-0f7914e4a6c1 of volume 4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] snapshot_file for this snap is: volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0268ca9-f5a5-49a5-9943-1080aee6ff92]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:35 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28" returned: 0 in 0.459s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:35 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 1G Sep 09 14:47:35 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:35 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 Sep 09 14:47:35 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:35 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f.9c86c21f-e223-4e61-9c66-14148c1bad60" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-9c86c21f-e223-4e61-9c66-14148c1bad60" released by "_delete_snapshot" :: held 1.638s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-31df05a2-0c70-4b68-be4d-5aec68289a7f" released by "delete_snapshot" :: held 1.676s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-e7bcd849-bd7b-4197-90f4-f05263307eec" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-e7bcd849-bd7b-4197-90f4-f05263307eec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Deleting offline snapshot ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 of volume e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] snapshot_file for this snap is: volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f4db0-0e51-42ca-ae36-d1fa841ac0b7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:35 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1" returned: 0 in 0.403s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efeea0e-3f7c-4100-94a2-aed019bea650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[583f563d-94e6-49ae-91d9-a97fe26831de]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 Sep 09 14:47:36 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 1G" returned: 0 in 0.490s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 Sep 09 14:47:36 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:36 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" returned: 0 in 0.385s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7bcd849-bd7b-4197-90f4-f05263307eec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dcd95-12b8-4e75-8e0d-38868d8e1fc7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650" returned: 0 in 0.381s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 0.313s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 is being set with open permissions: ugo+rw Sep 09 14:47:36 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:36 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec Sep 09 14:47:36 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 0.263s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info Sep 09 14:47:36 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1" returned: 0 in 0.393s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 Sep 09 14:47:36 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1 Sep 09 14:47:36 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:36 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info" returned: 0 in 0.271s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:36 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info is being set with open permissions: ugo+rw Sep 09 14:47:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:36 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info Sep 09 14:47:36 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:37 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650.feb04262-bcc5-4f24-a63a-0f7914e4a6c1" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-quobyte-feb04262-bcc5-4f24-a63a-0f7914e4a6c1" released by "_delete_snapshot" :: held 1.558s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-quobyte-4efeea0e-3f7c-4100-94a2-aed019bea650" released by "delete_snapshot" :: held 1.586s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:37 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" returned: 0 in 0.377s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:37 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1 Sep 09 14:47:37 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.quota [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Created reservations ['587f6335-e45d-4f85-bf32-6e7275a86723', '98547e01-7a33-4c6d-992c-f724dec22338', 'aa98fc75-8be9-4dbc-986b-362b80acb66d', 'fa0fafe6-9417-4a55-9714-a28a4fda8a66'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Delete snapshot completed successfully. Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-55527952-163b-40f6-9c2a-e9a1d1e4d762 req-5f46173a-0864-4973-ac90-3b82439ba3b6 tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-feb04262-bcc5-4f24-a63a-0f7914e4a6c1-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:37 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.info" returned: 0 in 0.293s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.267s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Creating offline snapshot a18a9db8-524e-4d72-aef3-c6c62f294c02 of volume d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6285f65c-241c-4311-b82b-aa3157c04a8a tempest-VolumesSnapshotListTestJSON-2094745919 None] Create snapshot completed successfully Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1fbb40-7605-4a2d-ab32-c2c9b54c6821]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:37 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec.ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-ce6f4a3f-7ef0-4227-b19c-0ad6235846e1" released by "_delete_snapshot" :: held 1.543s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-e7bcd849-bd7b-4197-90f4-f05263307eec" released by "delete_snapshot" :: held 1.576s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:37 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 Sep 09 14:47:37 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:37 devstack cinder-volume[87325]: WARNING cinder.quota [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-5407815 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-5407815, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:37 devstack cinder-volume[87325]: WARNING cinder.quota [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-5407815 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-5407815, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['620bf4ff-0d49-4818-b129-14edd8f25472', '79f13dbb-20a8-4c1f-9f77-1630d428b091', '870c574b-fe03-48d8-aa81-449498635281', '2abe61d0-45de-4f96-92dd-a7294f33420e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['cc6c91c8-603a-4860-a340-78e74627468d', '192b1ffa-b3b4-4f70-9521-6a9eb4c1e880', '25cb7b18-160b-4604-93d0-fc1c7d62d2cf', '6993632f-2eba-4c28-8225-42331c319e86'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-74c1c41f-3a06-4890-af1c-c52bb95f23e7 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot 890734c2-ed25-4272-984d-06124d60bd60: deleted successfully Sep 09 14:47:37 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7" returned: 0 in 0.404s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:37 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 1G Sep 09 14:47:37 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "cinder-4efeea0e-3f7c-4100-94a2-aed019bea650-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-4efeea0e-3f7c-4100-94a2-aed019bea650-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "cinder-quobyte-4efeea0e-3f7c-4100-94a2-aed019bea650" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-quobyte-4efeea0e-3f7c-4100-94a2-aed019bea650" acquired by "delete_volume" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ad9f6-16d5-4c78-a9bc-01bb77b1dca4]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:38 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 Sep 09 14:47:38 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:38 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 1G" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0dec666-2dfe-4482-a625-aba10da906b7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:38 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0dec666-2dfe-4482-a625-aba10da906b7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 Sep 09 14:47:38 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:38 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650" returned: 0 in 0.375s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:38 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650 Sep 09 14:47:38 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:38 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0dec666-2dfe-4482-a625-aba10da906b7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:38 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 is being set with open permissions: ugo+rw Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:38 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 Sep 09 14:47:38 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:38 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4efeea0e-3f7c-4100-94a2-aed019bea650" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-quobyte-4efeea0e-3f7c-4100-94a2-aed019bea650" released by "delete_volume" :: held 0.719s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG cinder.quota [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Created reservations ['56a14a6f-efb5-4101-8bc6-a3b35174645f', '7ea64fa7-d321-4a94-9d3f-8ca7b4c50af1', '38e5a1e5-c4bb-4e09-98ae-6c7df072f003', '901fcf92-4c39-405d-b60d-95074983661b'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:38 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:38 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:38 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:38 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info Sep 09 14:47:38 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-31df05a2-0c70-4b68-be4d-5aec68289a7f" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-31df05a2-0c70-4b68-be4d-5aec68289a7f" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:39 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.296s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.manager [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ebf63-255d-416f-857f-7d4f9ffc625e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Deleted volume successfully. Sep 09 14:47:39 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:39 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info is being set with open permissions: ugo+rw Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-727520f1-ed81-4e39-b77f-1b039ab6ae45 req-8df217ac-9bef-4818-a332-6e7f4177555e tempest-VolumesSnapshotsTestJSON-1083925804 None] Lock "cinder-4efeea0e-3f7c-4100-94a2-aed019bea650-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:39 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info Sep 09 14:47:39 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:39 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f Sep 09 14:47:39 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:39 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.info" returned: 0 in 0.262s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.441s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Creating offline snapshot c0828e1d-62cd-4986-bbe6-e88021bb928a of volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c3efa9-62c4-402e-806c-5887f9076da1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:39 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1771d374-1bbf-4127-9837-ee65b4c12a8d tempest-TestStampPattern-1011391749 None] Create snapshot completed successfully Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:39 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f Sep 09 14:47:39 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:39 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:39 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:39 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31df05a2-0c70-4b68-be4d-5aec68289a7f" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-31df05a2-0c70-4b68-be4d-5aec68289a7f" released by "delete_volume" :: held 0.819s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-e7bcd849-bd7b-4197-90f4-f05263307eec" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-e7bcd849-bd7b-4197-90f4-f05263307eec" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ba656-8f0b-472c-ade3-15bbff95b7d6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:39 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 0.407s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:39 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a 1G Sep 09 14:47:39 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:40 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec Sep 09 14:47:40 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:40 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec" returned: 0 in 0.503s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:40 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec Sep 09 14:47:40 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:40 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a 1G" returned: 0 in 0.615s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:40 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:40 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:40 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e7bcd849-bd7b-4197-90f4-f05263307eec" returned: 0 in 0.311s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-e7bcd849-bd7b-4197-90f4-f05263307eec" released by "delete_volume" :: held 0.881s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['5ae9d44e-14c7-4de2-adbf-3fd9efdbc133'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:40 devstack cinder-volume[87325]: WARNING cinder.quota [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-5407815 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-5407815, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['3aa21cb5-f2a3-428d-9d08-bc24c4781481', '60d3b07e-c8f1-4171-a4cf-5fc2ecc2eaa4', 'dc0edb42-793a-41e0-b422-7bc68fcc532b', '130aacfd-5f68-4c25-b051-ef0629648fce'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:40 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.403s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:40 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a is being set with open permissions: ugo+rw Sep 09 14:47:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:40 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:40 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['a3c881a3-cc78-42ca-8a91-2efa7b96165a', '98a82e91-53d8-46be-824f-c0b0a33d6e95', 'c1b8c3b1-d746-4177-960e-c4d282722004', '9fa04b4c-e253-44e5-b3e2-426daf1b7230'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:41 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:41 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:41 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.356s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c229868d-d36c-46f6-aafd-04948d505ada tempest-VolumesSnapshotListTestJSON-2094745919 None] Create snapshot completed successfully Sep 09 14:47:41 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.422s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:41 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-dfa3e328-07da-4b03-a147-e08a5123f816 tempest-GroupSnapshotsTest-1434934899 None] Delete group completed successfully. Sep 09 14:47:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cc28c757-68b8-4de4-bb19-15de2275de41 tempest-GroupSnapshotsTest-1434934899 None] Group tempest-GroupSnapshotsTest-Group-215752164: creating Sep 09 14:47:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cc28c757-68b8-4de4-bb19-15de2275de41 tempest-GroupSnapshotsTest-1434934899 None] Group tempest-GroupSnapshotsTest-Group-215752164: created successfully Sep 09 14:47:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cc28c757-68b8-4de4-bb19-15de2275de41 tempest-GroupSnapshotsTest-1434934899 None] Create group completed successfully. Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Creating offline snapshot 92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 of volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[466526d3-6818-490b-aef4-0cc5edde0628]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:42 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:42 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:42 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.416s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:42 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 1G Sep 09 14:47:42 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:43 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 1G" returned: 0 in 0.574s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:43 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 Sep 09 14:47:43 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:43 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" returned: 0 in 0.455s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:43 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 is being set with open permissions: ugo+rw Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:43 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 Sep 09 14:47:43 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (bba8f181-40e2-4c1f-9a4e-91494c4eb7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f9a973-c9fd-48f7-973b-3a635bd9bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f9a973-c9fd-48f7-973b-3a635bd9bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676517238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=862a9630-d1d9-4033-80c6-00b0301066cf,host='devstack@QuobyteHD#QuobyteHD',id=3c8d0605-fdf4-4dcb-9585-3cec10828f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:44Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a6cafe1-08f7-4f9e-8dfa-8e67e3d10641),volume_type_id=1a6cafe1-08f7-4f9e-8dfa-8e67e3d10641)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32886a5c-f6ec-478d-8c10-c10603db47c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32886a5c-f6ec-478d-8c10-c10603db47c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe357cf-ea23-4b81-b463-8a77fe7bd998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe357cf-ea23-4b81-b463-8a77fe7bd998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8d0605-fdf4-4dcb-9585-3cec10828f6a', 'volume_name': 'volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79770be4-0d61-46c3-8951-46c310ffffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79770be4-0d61-46c3-8951-46c310ffffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea79b19-1b1c-4286-8009-a8d26744c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Volume 3c8d0605-fdf4-4dcb-9585-3cec10828f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a', 'volume_size': 1} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:44 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" returned: 0 in 0.314s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=862a9630-d1d9-4033-80c6-00b0301066cf,created_at=2026-09-09T12:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676517238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=862a9630-d1d9-4033-80c6-00b0301066cf,host='devstack@QuobyteHD#QuobyteHD',id=3c8d0605-fdf4-4dcb-9585-3cec10828f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b03c98f7c7c43e4b13b90288dd75ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:44Z,use_quota=True,user_id='5c80624b3cf1432c86f8c1a859e02910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a6cafe1-08f7-4f9e-8dfa-8e67e3d10641),volume_type_id=1a6cafe1-08f7-4f9e-8dfa-8e67e3d10641)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Creating volume 3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:44 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:44 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a 1073741824 Sep 09 14:47:44 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-243a3404-7958-4b1f-a142-62696bdb973c tempest-VolumesSnapshotListTestJSON-2094745919 None] Create snapshot completed successfully Sep 09 14:47:44 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a 1073741824" returned: 0 in 0.497s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:44 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a Sep 09 14:47:44 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:45 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" returned: 0 in 0.349s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea79b19-1b1c-4286-8009-a8d26744c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d58b4f-185a-489f-a257-5bcdf510deb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:45 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Volume volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a (3c8d0605-fdf4-4dcb-9585-3cec10828f6a): created successfully Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d58b4f-185a-489f-a257-5bcdf510deb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Flow 'volume_create_manager' (bba8f181-40e2-4c1f-9a4e-91494c4eb7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:45 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4e15f94b-b077-4e72-b917-f8daba50a337 tempest-GroupSnapshotsTest-1434934899 None] Created volume successfully. Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Deleting offline snapshot 92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 of volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] snapshot_file for this snap is: volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c4c272-3086-48a1-8b91-00240e74dac9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:46 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 Sep 09 14:47:46 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:46 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" returned: 0 in 0.542s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[110556b5-d067-46e8-a996-a366617c3b45]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:46 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:46 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] GroupSnapshot e520459a-cdd2-4df2-bd93-2598c81aef1e: creating. Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=168,cinder:SELECT=153,cinder:INSERT=43,cinder:DELETE=10 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Group snapshot e520459a-cdd2-4df2-bd93-2598c81aef1e: creating. {{(pid=87325) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Creating offline snapshot 8e8c439e-7cb2-450d-b595-6afb3aaf76d1 of volume 3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf80370-714a-40ef-896d-8d4452a4c245]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:47 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a Sep 09 14:47:47 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:47 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.670s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:47 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 Sep 09 14:47:47 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:47 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" returned: 0 in 0.455s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:47 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 1G Sep 09 14:47:47 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:47 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" returned: 0 in 0.529s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:47 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2 Sep 09 14:47:47 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:47 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 1G" returned: 0 in 0.609s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:47 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 Sep 09 14:47:47 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:48 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" returned: 0 in 0.343s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2" released by "_delete_snapshot" :: held 2.233s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" released by "delete_snapshot" :: held 2.268s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Created reservations ['f8db592f-d76c-4d28-8bcf-2efad2c1c0df', '0762d6f0-39b0-4803-a8c7-e994cfb7419b', '3db45999-a97b-4f81-addd-f69d5ccdf3dd', '59f4872d-f6ed-40be-b33d-12f1f17af642'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Delete snapshot completed successfully. Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a1f4e8c0-3e18-4a5b-a4bb-255af0a57f14 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-92a0c7b3-70b4-4a0b-8de7-8e8e668f45c2-delete_snapshot" released by "delete_snapshot" :: held 2.445s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:48 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1" returned: 0 in 0.370s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:48 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:48 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 Sep 09 14:47:48 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Flow 'volume_create_manager' (cdc9342c-8fbc-417c-9060-6d6ca7bf6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e515dc1a-5027-43cd-8925-99568fe503ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:48 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e515dc1a-5027-43cd-8925-99568fe503ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1299197046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8032092df1cf4dd0b002947d004b0b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a18a9db8-524e-4d72-aef3-c6c62f294c02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:49Z,use_quota=True,user_id='2a7f24305e6743b5a90f1cad172e03a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22599442-d4b1-4ddd-a9ed-4a9b9cfc8451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22599442-d4b1-4ddd-a9ed-4a9b9cfc8451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed19bc8-0dd4-48d1-99b2-87dfbb85ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed19bc8-0dd4-48d1-99b2-87dfbb85ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d', 'volume_name': 'volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d', 'volume_size': 1, 'snapshot_id': 'a18a9db8-524e-4d72-aef3-c6c62f294c02'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8d88f9-740a-4811-aceb-9160afd39ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8d88f9-740a-4811-aceb-9160afd39ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd39d299-b793-4801-83dc-b593fa51d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:48 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Volume e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d', 'volume_size': 1, 'snapshot_id': 'a18a9db8-524e-4d72-aef3-c6c62f294c02'} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1" returned: 0 in 0.383s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:48 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info Sep 09 14:47:48 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:49 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info" returned: 0 in 0.319s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:49 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-c0828e1d-62cd-4986-bbe6-e88021bb928a-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:49 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info Sep 09 14:47:49 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-c0828e1d-62cd-4986-bbe6-e88021bb928a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-c0828e1d-62cd-4986-bbe6-e88021bb928a" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-c0828e1d-62cd-4986-bbe6-e88021bb928a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Deleting offline snapshot c0828e1d-62cd-4986-bbe6-e88021bb928a of volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] snapshot_file for this snap is: volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d558bb4d-54e8-48d1-9c99-7f1bc603972f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:49 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.info" returned: 0 in 0.292s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:49 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:49 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.681s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-quobyte-a18a9db8-524e-4d72-aef3-c6c62f294c02-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-a18a9db8-524e-4d72-aef3-c6c62f294c02-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Creating volume e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d from snapshot a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-quobyte-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] snapshot: a18a9db8-524e-4d72-aef3-c6c62f294c02, volume: e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb8e67-dd70-4522-9fba-da8b2f49d6a1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7ef3170f-0807-4753-ba32-ca03ec895ed7 tempest-GroupSnapshotsTest-1434934899 None] group_snapshot e520459a-cdd2-4df2-bd93-2598c81aef1e: created successfully Sep 09 14:47:49 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 Sep 09 14:47:49 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:49 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.578s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870c7f4-1d58-44d2-8dc6-fc870c5ef81d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:49 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:49 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:50 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02" returned: 0 in 0.503s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0dec666-2dfe-4482-a625-aba10da906b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58d5135-e0c6-48df-a6e9-c88f872b2859]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:50 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 Sep 09 14:47:50 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:50 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 0.520s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] group_snapshot e520459a-cdd2-4df2-bd93-2598c81aef1e: deleting Sep 09 14:47:50 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:50 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] group_snapshot e520459a-cdd2-4df2-bd93-2598c81aef1e: deleting {{(pid=87325) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-8e8c439e-7cb2-450d-b595-6afb3aaf76d1" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-8e8c439e-7cb2-450d-b595-6afb3aaf76d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Deleting offline snapshot 8e8c439e-7cb2-450d-b595-6afb3aaf76d1 of volume 3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] snapshot_file for this snap is: volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5ac244-6143-4183-a80a-543fd9b604e6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:50 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7" returned: 0 in 0.542s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:47:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:50 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d Sep 09 14:47:50 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:50 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 Sep 09 14:47:50 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:51 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.746s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:51 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a Sep 09 14:47:51 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:51 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1" returned: 0 in 0.603s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d9e4e-4b6f-4de5-92eb-04079bdefbbb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:51 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a Sep 09 14:47:51 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:51 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.c0828e1d-62cd-4986-bbe6-e88021bb928a" returned: 0 in 0.458s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-c0828e1d-62cd-4986-bbe6-e88021bb928a" released by "_delete_snapshot" :: held 2.514s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" released by "delete_snapshot" :: held 2.570s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Created reservations ['30491430-79f1-4a98-bb4f-79480543fd29', '720a836c-12ba-464b-80ed-a4e1659221b3', '6aa2cf90-5eb5-41ca-ac85-17381258d4a4', 'c8d42f52-ff01-4fa2-86f1-8639fdd868a4'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:52 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Delete snapshot completed successfully. Sep 09 14:47:52 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" returned: 0 in 0.968s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd07539-81bc-4626-9ae7-42ad032a0412 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-c0828e1d-62cd-4986-bbe6-e88021bb928a-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:52 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 Sep 09 14:47:52 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:52 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:52 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-f2ac0f83-0214-40c7-839d-f0e7879e3733-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-f2ac0f83-0214-40c7-839d-f0e7879e3733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-f2ac0f83-0214-40c7-839d-f0e7879e3733" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-f2ac0f83-0214-40c7-839d-f0e7879e3733" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Deleting offline snapshot f2ac0f83-0214-40c7-839d-f0e7879e3733 of volume 09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] snapshot_file for this snap is: volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8084e1f9-b66b-4d1d-935f-15b1d9b6e1b8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:53 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:53 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:53 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 1.052s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:47:53 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1" returned: 0 in 1.607s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:53 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1 Sep 09 14:47:53 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:54 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 1.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a25a9e-0422-488f-9c6b-138f023e6b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:47:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93386510-55a2-4691-bab6-0d8523f01d32]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:54 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 Sep 09 14:47:54 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:54 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a.8e8c439e-7cb2-450d-b595-6afb3aaf76d1" returned: 0 in 1.008s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-8e8c439e-7cb2-450d-b595-6afb3aaf76d1" released by "_delete_snapshot" :: held 4.484s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" released by "delete_snapshot" :: held 4.545s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Flow 'volume_create_manager' (80794368-9ff9-46ce-af69-54b2db9a5b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e239a5-dd26-4299-be50-89510398336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e239a5-dd26-4299-be50-89510398336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-245899000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e599a3-8ce3-4565-acea-817ae719c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6431afd3f4934b1582f0bb323cb5f5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:55Z,use_quota=True,user_id='685f5c3ae42646bfac68c85c66525f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04545762-1741-49f2-ae21-d1da40e2056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04545762-1741-49f2-ae21-d1da40e2056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c3e8ae-68ee-4f47-bbc4-a7374c237fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c3e8ae-68ee-4f47-bbc4-a7374c237fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e599a3-8ce3-4565-acea-817ae719c465', 'volume_name': 'volume-80e599a3-8ce3-4565-acea-817ae719c465', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2723b0-c384-4b67-abb5-98e80bed4950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2723b0-c384-4b67-abb5-98e80bed4950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c0f8dd-3871-4f96-9e64-b21c65c660e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:55 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Volume 80e599a3-8ce3-4565-acea-817ae719c465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e599a3-8ce3-4565-acea-817ae719c465', 'volume_size': 1} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:55 devstack cinder-volume[87325]: WARNING cinder.quota [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-14534821 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-14534821, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:55 devstack cinder-volume[87325]: WARNING cinder.quota [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-14534821 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-14534821, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:55 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28" returned: 0 in 1.325s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:55 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['593b7225-6e1f-4032-930c-28d253a8879e', 'ef90caf0-d2ce-4fa5-a783-f8fc23d619a0', '3a640501-8eb7-4906-8dcd-3c050bde2ee7', '434735ab-6862-4d7c-ae99-20fe69bdd723'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:55 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:55 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2746462f-ebce-45d4-b99d-76e75ed926fb tempest-GroupSnapshotsTest-1434934899 None] group_snapshot e520459a-cdd2-4df2-bd93-2598c81aef1e: deleted successfully Sep 09 14:47:57 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 1.297s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:57 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733 Sep 09 14:47:57 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "cinder-quobyte-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" acquired by "delete_volume" :: waited 0.059s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e464a-9538-4b2d-b28f-4bcecdb91c06]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:57 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a Sep 09 14:47:57 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:58 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28.f2ac0f83-0214-40c7-839d-f0e7879e3733" returned: 0 in 1.076s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=185,cinder:INSERT=44,cinder:UPDATE=156,cinder:DELETE=8 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-f2ac0f83-0214-40c7-839d-f0e7879e3733" released by "_delete_snapshot" :: held 5.583s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" released by "delete_snapshot" :: held 5.653s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Created reservations ['04355dc4-384c-4682-8ea6-bde1c420e82e', '86e88f14-335e-4acf-b372-76c2aad763c1', '12d50bcf-9604-4cdb-b5ec-496200db2cf2', '0b5aea4c-0410-4376-ac15-b16a2289c56d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:58 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" returned: 0 in 7.770s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:47:58 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Converted 1024.00 MB image at 131.77 MB/s Sep 09 14:47:58 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d is being set with open permissions: ugo+rw Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:58 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" returned: 0 in 0.917s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:58 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d Sep 09 14:47:58 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:58 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a Sep 09 14:47:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Delete snapshot completed successfully. Sep 09 14:47:58 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-90b18e66-83b9-40ea-a9e2-080c212678e3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-f2ac0f83-0214-40c7-839d-f0e7879e3733-delete_snapshot" released by "delete_snapshot" :: held 5.932s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:58 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" returned: 0 in 0.406s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" released by "_copy_volume_from_snapshot" :: held 9.395s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:58 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Lock "cinder-quobyte-3c8d0605-fdf4-4dcb-9585-3cec10828f6a" released by "delete_volume" :: held 1.514s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-a18a9db8-524e-4d72-aef3-c6c62f294c02-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" released by "_create_volume_from_snapshot" :: held 9.562s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:47:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.608s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.385s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-245899000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e599a3-8ce3-4565-acea-817ae719c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6431afd3f4934b1582f0bb323cb5f5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:47:55Z,use_quota=True,user_id='685f5c3ae42646bfac68c85c66525f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Creating volume 80e599a3-8ce3-4565-acea-817ae719c465 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:47:59 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:59 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 1073741824 Sep 09 14:47:59 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd39d299-b793-4801-83dc-b593fa51d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d', 'volume_size': 1, 'snapshot_id': 'a18a9db8-524e-4d72-aef3-c6c62f294c02'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beca62b3-59c4-478b-9292-3698f109af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:47:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Volume volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d (e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d): created successfully Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beca62b3-59c4-478b-9292-3698f109af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Flow 'volume_create_manager' (cdc9342c-8fbc-417c-9060-6d6ca7bf6b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:47:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0249a4b2-509b-4db3-bda9-02695ba4ccbb tempest-TestStampPattern-1011391749 None] Created volume successfully. Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['638ed46b-43ad-4d6b-b4a4-2ca8f494db86'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:59 devstack cinder-volume[87325]: WARNING cinder.quota [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-14534821 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-14534821, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Created reservations ['e051263f-933d-41d2-8d05-75fa8c9e1265', '10fced8b-d668-4014-a0ed-80e65a9cd4ca', '473678ae-293e-4393-bb5d-e68570e783ab', '0fd98027-d499-47e2-badc-febf6635febb'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:59 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:47:59 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-09a25a9e-0422-488f-9c6b-138f023e6b28-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:59 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 1073741824" returned: 0 in 0.579s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-09a25a9e-0422-488f-9c6b-138f023e6b28-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:59 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.347s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:47:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e8c2b4c2-6887-4e4e-bb8a-78a9ec6708a0 tempest-GroupSnapshotsTest-1434934899 None] Delete group completed successfully. Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:47:59 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 Sep 09 14:47:59 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca84994-a840-4cdd-b81f-997a08535475]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:47:59 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 Sep 09 14:47:59 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:47:59 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465" returned: 0 in 0.288s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:47:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c0f8dd-3871-4f96-9e64-b21c65c660e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e599a3-8ce3-4565-acea-817ae719c465', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5be6f47-6ad0-4fbd-95c5-90f36ed6a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Volume volume-80e599a3-8ce3-4565-acea-817ae719c465 (80e599a3-8ce3-4565-acea-817ae719c465): created successfully Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5be6f47-6ad0-4fbd-95c5-90f36ed6a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Flow 'volume_create_manager' (80794368-9ff9-46ce-af69-54b2db9a5b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:00 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-95a66e3a-708e-49a0-980b-f82bda67236d tempest-VolumesServicesTestJSON-1443413146 None] Created volume successfully. Sep 09 14:48:00 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28" returned: 0 in 0.711s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:00 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28 Sep 09 14:48:00 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Acquiring lock "cinder-80e599a3-8ce3-4565-acea-817ae719c465-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Lock "cinder-80e599a3-8ce3-4565-acea-817ae719c465-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:00 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-09a25a9e-0422-488f-9c6b-138f023e6b28" returned: 0 in 0.509s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Acquiring lock "cinder-quobyte-80e599a3-8ce3-4565-acea-817ae719c465" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-quobyte-09a25a9e-0422-488f-9c6b-138f023e6b28" released by "delete_volume" :: held 1.308s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Lock "cinder-quobyte-80e599a3-8ce3-4565-acea-817ae719c465" acquired by "delete_volume" :: waited 0.036s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e587f6d1-d0f6-499f-86ad-2d2407cf821e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Created reservations ['61f126e1-15a4-4efa-a267-ad35771580e0', '724d76ff-7024-4675-a281-1b9af8e76727', 'ab500a74-0925-47ea-91b7-549dd21711d0', '7620dbd6-bf89-4815-916b-363b5a617378'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:01 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 Sep 09 14:48:01 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:01 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:01 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:01 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.326s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Deleted volume successfully. Sep 09 14:48:01 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465" returned: 0 in 0.561s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5ff21b47-07ea-457a-8d27-27d99bbdecd3 tempest-VolumesSnapshotListTestJSON-2094745919 None] Lock "cinder-09a25a9e-0422-488f-9c6b-138f023e6b28-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:01 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465 Sep 09 14:48:01 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:02 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-80e599a3-8ce3-4565-acea-817ae719c465" returned: 0 in 0.563s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Lock "cinder-quobyte-80e599a3-8ce3-4565-acea-817ae719c465" released by "delete_volume" :: held 1.184s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Created reservations ['b385b53a-45bb-4856-9d31-167f87e9ec8a', '434aac06-2454-408a-aebf-c89371ec009a', '4fcd2ec5-df81-4909-b5e9-8e1cd2b3c6d1', 'e69aeb4d-50d6-4a8e-946b-f51be60cb9af'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:02 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:02 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:02 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Deleted volume successfully. Sep 09 14:48:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-26286063-65af-44ce-8e2a-c61427d76252 tempest-VolumesServicesTestJSON-1443413146 None] Lock "cinder-80e599a3-8ce3-4565-acea-817ae719c465-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:12 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=27,cinder:UPDATE=36,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:48:12 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=46,cinder:UPDATE=60,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:48:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9c02832f-3bc5-4bd6-8511-04c4d21031f9 tempest-GroupsTest-1080081574 None] Group tempest-Group1-1897050072: creating Sep 09 14:48:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9c02832f-3bc5-4bd6-8511-04c4d21031f9 tempest-GroupsTest-1080081574 None] Group tempest-Group1-1897050072: created successfully Sep 09 14:48:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9c02832f-3bc5-4bd6-8511-04c4d21031f9 tempest-GroupsTest-1080081574 None] Create group completed successfully. Sep 09 14:48:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d8487a7-22c5-405b-b608-de21d24293b1 tempest-GroupsTest-1080081574 None] Group tempest-Group2-1564564649: creating Sep 09 14:48:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d8487a7-22c5-405b-b608-de21d24293b1 tempest-GroupsTest-1080081574 None] Group tempest-Group2-1564564649: created successfully Sep 09 14:48:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d8487a7-22c5-405b-b608-de21d24293b1 tempest-GroupsTest-1080081574 None] Create group completed successfully. Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Flow 'volume_create_manager' (965064b9-0a5e-4aff-b80e-4c427679c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38710482-ca19-4e2b-8aed-cde505590c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38710482-ca19-4e2b-8aed-cde505590c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-663125169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8175bb-c4ff-4055-86e0-a9d31dc3c797,host='devstack@QuobyteHD#QuobyteHD',id=d63ac05b-bd3d-4f2f-97c4-230c73de513c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb8d17f2b7745c990481638dded9867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:22Z,use_quota=True,user_id='62a91ffb62fb4ab9acb6b88635e43037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e4d259-fefb-4497-bc3d-5a73a499780f),volume_type_id=59e4d259-fefb-4497-bc3d-5a73a499780f)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b639f3e-5159-48e0-ba98-9ff987bdade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b639f3e-5159-48e0-ba98-9ff987bdade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae6f473-deee-48e4-bbdb-1ad75da2eb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae6f473-deee-48e4-bbdb-1ad75da2eb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63ac05b-bd3d-4f2f-97c4-230c73de513c', 'volume_name': 'volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4397c3-5738-4441-a327-9af846fd9b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4397c3-5738-4441-a327-9af846fd9b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc0aeb-5045-4f6c-b980-5eafd5db555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Volume d63ac05b-bd3d-4f2f-97c4-230c73de513c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c', 'volume_size': 1} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b8175bb-c4ff-4055-86e0-a9d31dc3c797,created_at=2026-09-09T12:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-663125169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8175bb-c4ff-4055-86e0-a9d31dc3c797,host='devstack@QuobyteHD#QuobyteHD',id=d63ac05b-bd3d-4f2f-97c4-230c73de513c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb8d17f2b7745c990481638dded9867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:22Z,use_quota=True,user_id='62a91ffb62fb4ab9acb6b88635e43037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e4d259-fefb-4497-bc3d-5a73a499780f),volume_type_id=59e4d259-fefb-4497-bc3d-5a73a499780f)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Creating volume d63ac05b-bd3d-4f2f-97c4-230c73de513c {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:48:22 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:22 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c 1073741824 Sep 09 14:48:22 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:22 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c 1073741824" returned: 0 in 0.552s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:23 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c Sep 09 14:48:23 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:23 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c" returned: 0 in 0.294s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc0aeb-5045-4f6c-b980-5eafd5db555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5675248-5502-4c74-8be6-a38b8f417525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Volume volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c (d63ac05b-bd3d-4f2f-97c4-230c73de513c): created successfully Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5675248-5502-4c74-8be6-a38b8f417525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Flow 'volume_create_manager' (965064b9-0a5e-4aff-b80e-4c427679c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-28804ad1-2f29-47c4-9de4-0ae01ccb758c tempest-GroupsTest-1080081574 None] Created volume successfully. Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Acquiring lock "cinder-quobyte-d63ac05b-bd3d-4f2f-97c4-230c73de513c" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Lock "cinder-quobyte-d63ac05b-bd3d-4f2f-97c4-230c73de513c" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7044b-7f13-462c-acc9-4fce49afbd35]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:24 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c Sep 09 14:48:24 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:24 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:24 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c Sep 09 14:48:24 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:24 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d63ac05b-bd3d-4f2f-97c4-230c73de513c" returned: 0 in 0.301s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Lock "cinder-quobyte-d63ac05b-bd3d-4f2f-97c4-230c73de513c" released by "delete_volume" :: held 0.833s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Created reservations ['9173a89b-36dd-483c-b447-1cfe059641df'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:25 devstack cinder-volume[87325]: WARNING cinder.quota [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-186501940 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-186501940, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:48:25 devstack cinder-volume[87325]: WARNING cinder.quota [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-186501940 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-186501940, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Created reservations ['7490c261-171b-412a-b30c-d4453bc1d4ff', 'caf80f84-4f18-4ad8-a2fe-04bcfa7f6850', '0557fde2-790f-4b8b-aad1-64a325609be9', '05852274-2dd6-4f72-89f8-dae4d4c6fafe'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:25 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:25 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:25 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e439549c-9138-4c8e-9a52-48d2d58261be tempest-GroupsTest-1080081574 None] Delete group completed successfully. Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Created reservations ['eca42e6b-d42e-4d43-a76c-a539bb7961e9'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:25 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:25 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:26 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:26 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7fb75fe4-328b-4c39-b6b7-9616598e0472 tempest-GroupsTest-1080081574 None] Delete group completed successfully. Sep 09 14:48:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c65c9b6a-e5f0-4975-8d6a-039912467bef tempest-GroupsTest-1080081574 None] Group tempest-GroupsTest-Group-569109276: creating Sep 09 14:48:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c65c9b6a-e5f0-4975-8d6a-039912467bef tempest-GroupsTest-1080081574 None] Group tempest-GroupsTest-Group-569109276: created successfully Sep 09 14:48:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c65c9b6a-e5f0-4975-8d6a-039912467bef tempest-GroupsTest-1080081574 None] Create group completed successfully. Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Flow 'volume_create_manager' (70ccf3be-249e-4a52-a93c-1340e2bf67ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881ace72-de97-443f-8fd5-f9bc51c31567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881ace72-de97-443f-8fd5-f9bc51c31567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1575503550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39416de6-ae6f-4c1e-b6d3-fd591d65c68c,host='devstack@QuobyteHD#QuobyteHD',id=7c68fea4-e061-4eed-98c7-e56d24132642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb8d17f2b7745c990481638dded9867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:30Z,use_quota=True,user_id='62a91ffb62fb4ab9acb6b88635e43037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(535d1b83-860e-4e61-9ba9-97a1239032fa),volume_type_id=535d1b83-860e-4e61-9ba9-97a1239032fa)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b12485-e9b6-46f9-8850-3f7c1c7d9d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b12485-e9b6-46f9-8850-3f7c1c7d9d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740926ca-e3fa-4151-b9ff-89aba36e7132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740926ca-e3fa-4151-b9ff-89aba36e7132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c68fea4-e061-4eed-98c7-e56d24132642', 'volume_name': 'volume-7c68fea4-e061-4eed-98c7-e56d24132642', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcbbeee-9655-429a-9b88-e69131cb68e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcbbeee-9655-429a-9b88-e69131cb68e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a96334-dff3-4a66-a01a-588144402ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:29 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Volume 7c68fea4-e061-4eed-98c7-e56d24132642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c68fea4-e061-4eed-98c7-e56d24132642', 'volume_size': 1} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39416de6-ae6f-4c1e-b6d3-fd591d65c68c,created_at=2026-09-09T12:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1575503550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39416de6-ae6f-4c1e-b6d3-fd591d65c68c,host='devstack@QuobyteHD#QuobyteHD',id=7c68fea4-e061-4eed-98c7-e56d24132642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb8d17f2b7745c990481638dded9867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:30Z,use_quota=True,user_id='62a91ffb62fb4ab9acb6b88635e43037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(535d1b83-860e-4e61-9ba9-97a1239032fa),volume_type_id=535d1b83-860e-4e61-9ba9-97a1239032fa)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Creating volume 7c68fea4-e061-4eed-98c7-e56d24132642 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:48:29 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:48:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:29 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 1073741824 Sep 09 14:48:29 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:30 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 1073741824" returned: 0 in 0.665s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:30 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 Sep 09 14:48:30 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:30 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642" returned: 0 in 0.381s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a96334-dff3-4a66-a01a-588144402ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c68fea4-e061-4eed-98c7-e56d24132642', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e404d2dc-830c-4048-b423-4da08bf4c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:30 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Volume volume-7c68fea4-e061-4eed-98c7-e56d24132642 (7c68fea4-e061-4eed-98c7-e56d24132642): created successfully Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e404d2dc-830c-4048-b423-4da08bf4c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Flow 'volume_create_manager' (70ccf3be-249e-4a52-a93c-1340e2bf67ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b9093972-9dfd-4acb-a64c-41e15d043eae tempest-GroupsTest-1080081574 None] Created volume successfully. Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-7ce0d520-9287-495a-9cef-bb27bc8af6fb req-cc43c682-2027-4c8a-a438-74d22c870442 tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-7ce0d520-9287-495a-9cef-bb27bc8af6fb req-cc43c682-2027-4c8a-a438-74d22c870442 tempest-TestStampPattern-1011391749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-7ce0d520-9287-495a-9cef-bb27bc8af6fb req-cc43c682-2027-4c8a-a438-74d22c870442 tempest-TestStampPattern-1011391749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-7ce0d520-9287-495a-9cef-bb27bc8af6fb req-cc43c682-2027-4c8a-a438-74d22c870442 tempest-TestStampPattern-1011391749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1761389-9ce2-4f6f-984e-f1c9b033a9ae', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:48:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-7ce0d520-9287-495a-9cef-bb27bc8af6fb req-cc43c682-2027-4c8a-a438-74d22c870442 tempest-TestStampPattern-1011391749 None] attachment_update completed successfully. Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Flow 'volume_create_manager' (8ecfea8d-69f7-46ba-9439-fe629564f28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65096c83-0f2d-452f-a845-154d716ba9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65096c83-0f2d-452f-a845-154d716ba9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146498365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39416de6-ae6f-4c1e-b6d3-fd591d65c68c,host='devstack@QuobyteHD#QuobyteHD',id=c80ef560-2852-495a-9513-454f669b89aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb8d17f2b7745c990481638dded9867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:33Z,use_quota=True,user_id='62a91ffb62fb4ab9acb6b88635e43037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(535d1b83-860e-4e61-9ba9-97a1239032fa),volume_type_id=535d1b83-860e-4e61-9ba9-97a1239032fa)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f475c1-aa0e-4d5e-bf5c-9c4f5dde0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f475c1-aa0e-4d5e-bf5c-9c4f5dde0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d44ea8-2359-4177-aac3-e34250aee51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d44ea8-2359-4177-aac3-e34250aee51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80ef560-2852-495a-9513-454f669b89aa', 'volume_name': 'volume-c80ef560-2852-495a-9513-454f669b89aa', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66f72cc-9bab-4200-b881-4c8e0dab355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66f72cc-9bab-4200-b881-4c8e0dab355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcc6c70-6b1b-4c80-9baf-4414838193d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:32 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Volume c80ef560-2852-495a-9513-454f669b89aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80ef560-2852-495a-9513-454f669b89aa', 'volume_size': 1} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39416de6-ae6f-4c1e-b6d3-fd591d65c68c,created_at=2026-09-09T12:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146498365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39416de6-ae6f-4c1e-b6d3-fd591d65c68c,host='devstack@QuobyteHD#QuobyteHD',id=c80ef560-2852-495a-9513-454f669b89aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb8d17f2b7745c990481638dded9867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:33Z,use_quota=True,user_id='62a91ffb62fb4ab9acb6b88635e43037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(535d1b83-860e-4e61-9ba9-97a1239032fa),volume_type_id=535d1b83-860e-4e61-9ba9-97a1239032fa)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Creating volume c80ef560-2852-495a-9513-454f669b89aa {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:48:32 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:48:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:32 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa 1073741824 Sep 09 14:48:32 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:33 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa 1073741824" returned: 0 in 0.643s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:33 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa Sep 09 14:48:33 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:33 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:48:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcc6c70-6b1b-4c80-9baf-4414838193d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80ef560-2852-495a-9513-454f669b89aa', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd24778f-547a-4695-a88e-04292a57077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:34 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Volume volume-c80ef560-2852-495a-9513-454f669b89aa (c80ef560-2852-495a-9513-454f669b89aa): created successfully Sep 09 14:48:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd24778f-547a-4695-a88e-04292a57077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Flow 'volume_create_manager' (8ecfea8d-69f7-46ba-9439-fe629564f28b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d6fb538-6efd-40eb-86dc-e77e5807006f tempest-GroupsTest-1080081574 None] Created volume successfully. Sep 09 14:48:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-efab2e2c-7d20-4ab3-93bf-ae02ea1420e4 tempest-GroupsTest-1080081574 None] Update group completed successfully. Sep 09 14:48:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-3ab7cbc8-6d02-4d70-b461-f15c6030e497 req-28b08292-21ed-4f8b-a724-8289049be425 tempest-TestStampPattern-1011391749 None] Terminate volume connection completed successfully. Sep 09 14:48:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-3ab7cbc8-6d02-4d70-b461-f15c6030e497 req-28b08292-21ed-4f8b-a724-8289049be425 tempest-TestStampPattern-1011391749 None] Deleting attachment e1761389-9ce2-4f6f-984e-f1c9b033a9ae. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:48:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0a832b5d-cb81-4d87-934c-0eed980d3616 tempest-GroupsTest-1080081574 None] Update group completed successfully. Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Acquiring lock "cinder-quobyte-7c68fea4-e061-4eed-98c7-e56d24132642" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Lock "cinder-quobyte-7c68fea4-e061-4eed-98c7-e56d24132642" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d12b97b-ecaa-4938-9a20-059d8f9d2efb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:39 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 Sep 09 14:48:39 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:39 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642" returned: 0 in 0.420s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:39 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642 Sep 09 14:48:39 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:39 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7c68fea4-e061-4eed-98c7-e56d24132642" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Lock "cinder-quobyte-7c68fea4-e061-4eed-98c7-e56d24132642" released by "delete_volume" :: held 0.776s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Acquiring lock "cinder-quobyte-c80ef560-2852-495a-9513-454f669b89aa" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Lock "cinder-quobyte-c80ef560-2852-495a-9513-454f669b89aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daa38cf-c65f-4510-b202-ce63c571d19a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:39 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa Sep 09 14:48:39 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:40 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa" returned: 0 in 0.469s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:40 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa Sep 09 14:48:40 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:40 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c80ef560-2852-495a-9513-454f669b89aa" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Lock "cinder-quobyte-c80ef560-2852-495a-9513-454f669b89aa" released by "delete_volume" :: held 0.873s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Created reservations ['378aec6c-26bb-4719-8d39-8b46757fe9e7'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:40 devstack cinder-volume[87325]: WARNING cinder.quota [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-879479857 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-879479857, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:48:40 devstack cinder-volume[87325]: WARNING cinder.quota [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-879479857 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-879479857, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:48:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Created reservations ['d2d909dd-7b6c-4974-9aca-5c47af1b28df', 'f199936c-1e6f-4e93-92bc-5d070a45464d', '106da8ff-0917-4199-8223-54aa70644120', 'be124e3d-9f23-4c90-99a7-594c5726d48d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Created reservations ['f8a1e0df-bb2e-4d57-ac92-7cc87794770c', '4c1ad665-92ad-4bf3-9fc9-b4d0044f7401', 'f2f2d4b5-b173-4a84-ae6e-80ad7ddef001', '014aa6a1-0b3c-42b5-ade7-b98d43ef2251'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:41 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:41 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:41 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:41 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8ee8cce5-dec0-4219-a8da-28568910fc0c tempest-GroupsTest-1080081574 None] Delete group completed successfully. Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Flow 'volume_create_manager' (09e7775d-0422-444d-a739-854e89619ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95678902-9fcf-45ce-9bce-9b0990e42361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95678902-9fcf-45ce-9bce-9b0990e42361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-523732758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82755c24-e3e0-4696-95c7-963fdea77278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4bd06fa8784a6ab1697dfda7a79dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:42Z,use_quota=True,user_id='9d0b9d5ef84643fb8f716b4af1b2862d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dd99f7-3d73-44e3-b697-152f030ac8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dd99f7-3d73-44e3-b697-152f030ac8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595c3cdd-1352-4bc7-b48a-a57fb6d2ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:42 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Lock "cinder-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-quobyte-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085db23-4cc5-462e-adb2-aaad7a35b67b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595c3cdd-1352-4bc7-b48a-a57fb6d2ed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82755c24-e3e0-4696-95c7-963fdea77278', 'volume_name': 'volume-82755c24-e3e0-4696-95c7-963fdea77278', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198d131a-8918-42ce-84bc-b118652319a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198d131a-8918-42ce-84bc-b118652319a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07a3371-64ee-43dd-a8ad-eb33e448b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Volume 82755c24-e3e0-4696-95c7-963fdea77278: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82755c24-e3e0-4696-95c7-963fdea77278', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 14:48:43 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Trying to clone 82755c24-e3e0-4696-95c7-963fdea77278 from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:48:43 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d Sep 09 14:48:43 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:48:44 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Image download 20.69 MB at 20.69 MB/s Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f90d1-e42f-4918-8f7b-01e6c05785f9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:44 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" returned: 0 in 0.654s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:44 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d Sep 09 14:48:44 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:44 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD Sep 09 14:48:44 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:44 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d" released by "delete_volume" :: held 1.020s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:44 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 is fetched for user 9d0b9d5ef84643fb8f716b4af1b2862d. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Created reservations ['a1554d52-7ce2-4d03-bd10-7234090f09d5', '9dddd2f3-402f-411b-b48d-746380957cc5', '07c9385a-9485-41a1-812d-bf526a79facf', 'da90db6d-a8ba-4c63-a18d-d509c1b2be98'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3580a9d4-3863-4eb0-83e7-8c134377cfcb]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:45 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:45 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:45 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD Sep 09 14:48:45 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:45 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-523732758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82755c24-e3e0-4696-95c7-963fdea77278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4bd06fa8784a6ab1697dfda7a79dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:42Z,use_quota=True,user_id='9d0b9d5ef84643fb8f716b4af1b2862d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Creating volume 82755c24-e3e0-4696-95c7-963fdea77278 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:48:45 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:45 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.361s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:45 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Deleted volume successfully. Sep 09 14:48:45 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 1073741824 Sep 09 14:48:45 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a02fa86-2268-4c6c-8c40-49a0272fb96f tempest-TestStampPattern-1011391749 None] Lock "cinder-e0a3ba9c-7530-48fd-ae50-dc6c7e699a7d-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:45 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 1073741824" returned: 0 in 0.599s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:46 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 Sep 09 14:48:46 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:46 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278" returned: 0 in 0.315s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Attempting download of 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume 82755c24-e3e0-4696-95c7-963fdea77278. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-a18a9db8-524e-4d72-aef3-c6c62f294c02-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Lock "cinder-a18a9db8-524e-4d72-aef3-c6c62f294c02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-quobyte-d0dec666-2dfe-4482-a625-aba10da906b7" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-d0dec666-2dfe-4482-a625-aba10da906b7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-quobyte-a18a9db8-524e-4d72-aef3-c6c62f294c02" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b5471-5319-40d9-9334-56546c6e5a51]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-a18a9db8-524e-4d72-aef3-c6c62f294c02" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Deleting offline snapshot a18a9db8-524e-4d72-aef3-c6c62f294c02 of volume d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] snapshot_file for this snap is: volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f7e4ea-ba82-40df-a5dd-e2fe4928de10]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:46 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g Sep 09 14:48:46 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:46 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 Sep 09 14:48:46 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:46 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g" returned: 0 in 0.396s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:47 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g Sep 09 14:48:47 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:47 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02" returned: 0 in 0.545s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0dec666-2dfe-4482-a625-aba10da906b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8afa7cf-25bb-4957-82ec-c536e98f2d9e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:47 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g" returned: 1 in 0.398s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6__y9h6k1g' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7596a1e-e0a5-46bc-9f3c-409699a0d212]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:47 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 Sep 09 14:48:47 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:47 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD Sep 09 14:48:47 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:47 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] 0dcaa084-c738-4c9b-8211-0cc749ab59f6 was qcow2, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:47 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 Sep 09 14:48:47 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:47 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7" returned: 0 in 0.600s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:47 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 Sep 09 14:48:47 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:48 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02" returned: 0 in 0.387s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:48 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02 Sep 09 14:48:48 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:48 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7.a18a9db8-524e-4d72-aef3-c6c62f294c02" returned: 0 in 0.332s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-a18a9db8-524e-4d72-aef3-c6c62f294c02" released by "_delete_snapshot" :: held 2.021s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-d0dec666-2dfe-4482-a625-aba10da906b7" released by "delete_snapshot" :: held 2.068s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Created reservations ['35a7c0ff-618d-4d5c-b1fc-6da0f52edd4b', '2e8617c0-3acb-4e17-8c12-19a45a33ca6a', '5533a542-c11d-4b97-ad89-8d9aa2799e35', 'f6fda0a6-b771-4906-9b3f-14b421ae6e20'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Delete snapshot completed successfully. Sep 09 14:48:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-84591cc1-4788-42dc-97db-fe153d04a3b6 tempest-TestStampPattern-1011391749 None] Lock "cinder-a18a9db8-524e-4d72-aef3-c6c62f294c02-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:49 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278" returned: 0 in 2.061s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:49 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_rqimid58devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:48:49 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Converted 112.00 MB image at 54.27 MB/s Sep 09 14:48:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:49 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 1G Sep 09 14:48:49 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Flow 'volume_create_manager' (b12119f6-f49c-4feb-9210-1993fe7d9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0f1526-4b94-4444-b085-6b4abc11f1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0f1526-4b94-4444-b085-6b4abc11f1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1864021767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d5fe88-5eda-4eee-96ed-e088360c371c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5daa3c618e8d44b0ab5d77b5cd11b157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:50Z,use_quota=True,user_id='aedef5d08f2a4f188e40ade087a21a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd63568c-0947-4585-967d-e4d2e6ce0a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd63568c-0947-4585-967d-e4d2e6ce0a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42aca127-589b-4570-b73e-5fc315b236ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42aca127-589b-4570-b73e-5fc315b236ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d5fe88-5eda-4eee-96ed-e088360c371c', 'volume_name': 'volume-a5d5fe88-5eda-4eee-96ed-e088360c371c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52af95c9-197d-466d-bcab-91fb4b8d0fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52af95c9-197d-466d-bcab-91fb4b8d0fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cef29fc-c34f-43be-b922-d2b555d643f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Volume a5d5fe88-5eda-4eee-96ed-e088360c371c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d5fe88-5eda-4eee-96ed-e088360c371c', 'volume_size': 1} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1864021767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d5fe88-5eda-4eee-96ed-e088360c371c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5daa3c618e8d44b0ab5d77b5cd11b157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:48:50Z,use_quota=True,user_id='aedef5d08f2a4f188e40ade087a21a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Creating volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:48:50 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:50 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c 1073741824 Sep 09 14:48:50 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:50 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 1G" returned: 0 in 0.471s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Downloaded image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume 82755c24-e3e0-4696-95c7-963fdea77278 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 for user 9d0b9d5ef84643fb8f716b4af1b2862d is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Marking volume 82755c24-e3e0-4696-95c7-963fdea77278 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Copying metadata from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 to 82755c24-e3e0-4696-95c7-963fdea77278. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Creating volume glance metadata for volume 82755c24-e3e0-4696-95c7-963fdea77278 backed by image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07a3371-64ee-43dd-a8ad-eb33e448b46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82755c24-e3e0-4696-95c7-963fdea77278', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80dd998-ea15-40b1-a1c9-9c0551ec7763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Volume volume-82755c24-e3e0-4696-95c7-963fdea77278 (82755c24-e3e0-4696-95c7-963fdea77278): created successfully Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80dd998-ea15-40b1-a1c9-9c0551ec7763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Flow 'volume_create_manager' (09e7775d-0422-444d-a739-854e89619ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5c744041-fad4-4519-a7b6-f527bf4ecd34 tempest-TestShelveInstance-1499452957 None] Created volume successfully. Sep 09 14:48:50 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c 1073741824" returned: 0 in 0.749s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:50 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c Sep 09 14:48:50 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:51 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c" returned: 0 in 0.313s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cef29fc-c34f-43be-b922-d2b555d643f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d5fe88-5eda-4eee-96ed-e088360c371c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7de266-5463-4af6-9abf-a7ff4b1c6719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:48:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Volume volume-a5d5fe88-5eda-4eee-96ed-e088360c371c (a5d5fe88-5eda-4eee-96ed-e088360c371c): created successfully Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7de266-5463-4af6-9abf-a7ff4b1c6719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:48:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Flow 'volume_create_manager' (b12119f6-f49c-4feb-9210-1993fe7d9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:48:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-75738fbf-6037-4214-b759-3b545b9e026b tempest-SnapshotsActionsTest-333444930 None] Created volume successfully. Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:52 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:52 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Creating offline snapshot c2dace30-e1b8-48d8-879c-2e156017a682 of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[376fdd0c-a184-4402-917c-0560098ca12f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:52 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:48:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:48:52 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c Sep 09 14:48:52 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:52 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:53 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 1G Sep 09 14:48:53 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:53 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 1G" returned: 0 in 0.594s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:53 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:48:53 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:54 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.460s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:54 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 is being set with open permissions: ugo+rw Sep 09 14:48:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:54 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:48:54 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:54 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.295s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:54 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info Sep 09 14:48:54 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:54 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:54 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info is being set with open permissions: ugo+rw Sep 09 14:48:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:54 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info Sep 09 14:48:54 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-d0dec666-2dfe-4482-a625-aba10da906b7-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Lock "cinder-d0dec666-2dfe-4482-a625-aba10da906b7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:55 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.info" returned: 0 in 0.473s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Acquiring lock "cinder-quobyte-d0dec666-2dfe-4482-a625-aba10da906b7" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ac805ce6-3a20-4106-918a-bb7314f02f36 tempest-SnapshotsActionsTest-333444930 None] Create snapshot completed successfully Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-d0dec666-2dfe-4482-a625-aba10da906b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1f01e-7c12-4ac8-8d79-6b19b7d9297e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:55 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 Sep 09 14:48:55 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:55 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7" returned: 0 in 0.552s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:56 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7 Sep 09 14:48:56 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:56 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d0dec666-2dfe-4482-a625-aba10da906b7" returned: 0 in 0.539s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Lock "cinder-quobyte-d0dec666-2dfe-4482-a625-aba10da906b7" released by "delete_volume" :: held 1.211s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Created reservations ['3ced67bb-5fc4-47df-940d-cdc63114e452', 'c91c72f2-6b18-4b71-befb-7122b2cd6082', 'f1fe3197-456b-4537-953b-61fc2bc41ae3', 'c39e5d41-7e65-47fd-8c92-2b49d3f3bca9'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:56 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:48:56 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Creating offline snapshot 78853b00-c6e2-4bd5-82fb-31c860d9a624 of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e27cf-6016-4409-addb-0c40fcd3b3d3]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:57 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.394s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:48:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Deleted volume successfully. Sep 09 14:48:57 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:48:57 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e3b7c4a5-d314-4d77-9888-ffb1c2de7cf5 tempest-TestStampPattern-1011391749 None] Lock "cinder-d0dec666-2dfe-4482-a625-aba10da906b7-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:48:57 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.506s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-aed71bce-d2c6-4bcd-9f2f-902b5f202788 req-a3e655d5-2024-471c-93c0-77281cb454b0 tempest-TestShelveInstance-1499452957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:48:57 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 1G Sep 09 14:48:57 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:58 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 1G" returned: 0 in 0.588s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:58 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 Sep 09 14:48:58 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:58 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:58 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 is being set with open permissions: ugo+rw Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:58 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 Sep 09 14:48:58 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:58 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-aed71bce-d2c6-4bcd-9f2f-902b5f202788 req-a3e655d5-2024-471c-93c0-77281cb454b0 tempest-TestShelveInstance-1499452957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.293s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-aed71bce-d2c6-4bcd-9f2f-902b5f202788 req-a3e655d5-2024-471c-93c0-77281cb454b0 tempest-TestShelveInstance-1499452957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:48:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e077020a-b2da-4a70-8c07-0e652ccc9728 tempest-SnapshotsActionsTest-333444930 None] Create snapshot completed successfully Sep 09 14:48:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-aed71bce-d2c6-4bcd-9f2f-902b5f202788 req-a3e655d5-2024-471c-93c0-77281cb454b0 tempest-TestShelveInstance-1499452957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-82755c24-e3e0-4696-95c7-963fdea77278', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc473b50-dbe6-45e2-a1ed-fd8efbc49c26', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:48:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-aed71bce-d2c6-4bcd-9f2f-902b5f202788 req-a3e655d5-2024-471c-93c0-77281cb454b0 tempest-TestShelveInstance-1499452957 None] attachment_update completed successfully. Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-78853b00-c6e2-4bd5-82fb-31c860d9a624-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-78853b00-c6e2-4bd5-82fb-31c860d9a624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-78853b00-c6e2-4bd5-82fb-31c860d9a624" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-78853b00-c6e2-4bd5-82fb-31c860d9a624" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Deleting offline snapshot 78853b00-c6e2-4bd5-82fb-31c860d9a624 of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] snapshot_file for this snap is: volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[412e3660-a750-4de0-9217-6acb77237eba]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:48:59 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 Sep 09 14:48:59 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:48:59 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624" returned: 0 in 0.495s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[88408e6e-d495-4d92-9ac7-02f1a654cfac]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:48:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:00 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:00 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:00 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.441s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:00 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 Sep 09 14:49:00 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:01 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624" returned: 0 in 0.631s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:01 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624 Sep 09 14:49:01 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:01 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.78853b00-c6e2-4bd5-82fb-31c860d9a624" returned: 0 in 0.331s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-78853b00-c6e2-4bd5-82fb-31c860d9a624" released by "_delete_snapshot" :: held 2.050s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" released by "delete_snapshot" :: held 2.085s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Created reservations ['3614e566-fc2e-47be-a13e-7eb61e795a98', '481793c0-8dc8-4bdb-af06-eac591cab1c0', '4fa204eb-460d-4b5b-8e93-35396c94d681', '5382236f-778c-487e-8555-eb50818babc4'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Delete snapshot completed successfully. Sep 09 14:49:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d59032b4-08a7-4fe8-b178-09685a4b7138 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-78853b00-c6e2-4bd5-82fb-31c860d9a624-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:03 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Creating offline snapshot e75f9671-bc28-4c2b-87d2-3f6ec496fd1e of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:49:03 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[699510cd-749f-4ff9-a358-52a560b63db5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:03 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:03 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:04 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.646s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:04 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e 1G Sep 09 14:49:04 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:04 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e 1G" returned: 0 in 0.520s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:04 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e Sep 09 14:49:04 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:05 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" returned: 0 in 0.399s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:05 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e is being set with open permissions: ugo+rw Sep 09 14:49:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:05 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e Sep 09 14:49:05 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:05 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" returned: 0 in 0.532s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a6fcf695-2c49-4d33-83cf-13eaf41a3e76 tempest-SnapshotsActionsTest-333444930 None] Create snapshot completed successfully Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-e75f9671-bc28-4c2b-87d2-3f6ec496fd1e-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-e75f9671-bc28-4c2b-87d2-3f6ec496fd1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Deleting offline snapshot e75f9671-bc28-4c2b-87d2-3f6ec496fd1e of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] snapshot_file for this snap is: volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[37844ad0-097c-4c6d-bf44-93bbfc129c5a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:07 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e Sep 09 14:49:07 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:07 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" returned: 0 in 0.592s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9504c9-1bb6-4242-957f-38ae2e265b3f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:07 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:07 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:08 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.527s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:08 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e Sep 09 14:49:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:08 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:09 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" returned: 0 in 1.208s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:09 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e Sep 09 14:49:09 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:09 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" returned: 0 in 0.593s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-e75f9671-bc28-4c2b-87d2-3f6ec496fd1e" released by "_delete_snapshot" :: held 3.056s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" released by "delete_snapshot" :: held 3.102s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:10 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Created reservations ['84cdc0cf-5fca-48c3-af30-09f7503fe9b1', '57707d75-5a74-485d-8590-3c7521a92bc4', '3d805c03-7e6c-4af0-aaf1-9f11f613f88f', 'c491dd72-d081-4e69-9f24-4f302195f039'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Delete snapshot completed successfully. Sep 09 14:49:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-32a6b1e6-12fe-477a-8c2b-45840f182ae9 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-e75f9671-bc28-4c2b-87d2-3f6ec496fd1e-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Creating offline snapshot 3af32d29-dbb2-4fcd-9483-4756bc952e05 of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:49:12 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[30726d3b-270e-4fbd-8dc4-565855e1758a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:12 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:12 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:12 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.670s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:12 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 1G Sep 09 14:49:12 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:13 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 1G" returned: 0 in 1.137s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:13 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 Sep 09 14:49:13 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:14 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05" returned: 0 in 0.684s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:14 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 is being set with open permissions: ugo+rw Sep 09 14:49:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:14 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 Sep 09 14:49:14 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:15 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05" returned: 0 in 0.726s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:15 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=104,cinder:UPDATE=91,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:49:15 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=94,cinder:SELECT=99,cinder:DELETE=3,cinder:INSERT=30 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:49:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:15 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1c0384ab-4199-4390-9942-8de5c2e5b774 tempest-SnapshotsActionsTest-333444930 None] Create snapshot completed successfully Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (bc407933-0f53-4bd9-8d0b-30ddd229c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd730899-8d09-4da8-abb6-b8f484a0986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd730899-8d09-4da8-abb6-b8f484a0986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-515240743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f1ee05-8fdb-461f-be99-31f569558e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:16Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f931d9-4d33-44be-a75e-c4f7d0308b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f931d9-4d33-44be-a75e-c4f7d0308b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d185d9c-dd6c-42bf-9db6-ddf6fc91eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d185d9c-dd6c-42bf-9db6-ddf6fc91eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f1ee05-8fdb-461f-be99-31f569558e72', 'volume_name': 'volume-f0f1ee05-8fdb-461f-be99-31f569558e72', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e41e4-4bab-43de-80d5-5a8fc9cf855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e41e4-4bab-43de-80d5-5a8fc9cf855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c29648-747e-451c-956e-c3c4d26044c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:16 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Volume f0f1ee05-8fdb-461f-be99-31f569558e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f1ee05-8fdb-461f-be99-31f569558e72', 'volume_size': 1} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-515240743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f1ee05-8fdb-461f-be99-31f569558e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:16Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Creating volume f0f1ee05-8fdb-461f-be99-31f569558e72 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:16 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:16 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 1073741824 Sep 09 14:49:16 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-3af32d29-dbb2-4fcd-9483-4756bc952e05-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-3af32d29-dbb2-4fcd-9483-4756bc952e05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-3af32d29-dbb2-4fcd-9483-4756bc952e05" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-3af32d29-dbb2-4fcd-9483-4756bc952e05" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Deleting offline snapshot 3af32d29-dbb2-4fcd-9483-4756bc952e05 of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] snapshot_file for this snap is: volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9e96ba-1685-411e-9d5c-385235423945]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:17 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 Sep 09 14:49:17 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:17 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 1073741824" returned: 0 in 0.873s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:17 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05" returned: 0 in 0.615s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:17 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 Sep 09 14:49:17 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcdf410-797f-4c9b-845a-2704ee00ce79]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:17 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:17 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:17 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72" returned: 0 in 0.491s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c29648-747e-451c-956e-c3c4d26044c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f1ee05-8fdb-461f-be99-31f569558e72', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bf141e-d031-4398-b012-746a6e607916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Volume volume-f0f1ee05-8fdb-461f-be99-31f569558e72 (f0f1ee05-8fdb-461f-be99-31f569558e72): created successfully Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bf141e-d031-4398-b012-746a6e607916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (bc407933-0f53-4bd9-8d0b-30ddd229c762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-db8f851b-793f-4235-a4b4-6675390478fb tempest-VolumesActionsTest-1974533787 None] Created volume successfully. Sep 09 14:49:18 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.614s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:18 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 Sep 09 14:49:18 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7128c7f0-3907-4ede-95ad-df45e70bdeb9 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72" by "attach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7128c7f0-3907-4ede-95ad-df45e70bdeb9 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72" acquired by "attach_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7128c7f0-3907-4ede-95ad-df45e70bdeb9 tempest-VolumesActionsTest-1974533787 None] Attaching volume f0f1ee05-8fdb-461f-be99-31f569558e72 to instance 3f7e383d-3cd6-4ced-bcac-8d67562f374d at mountpoint /dev/vdb on host None. Sep 09 14:49:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7128c7f0-3907-4ede-95ad-df45e70bdeb9 tempest-VolumesActionsTest-1974533787 None] Attach volume completed successfully. Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7128c7f0-3907-4ede-95ad-df45e70bdeb9 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72" released by "attach_volume" :: held 0.142s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:18 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05" returned: 0 in 0.642s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:18 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05 Sep 09 14:49:18 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:19 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.3af32d29-dbb2-4fcd-9483-4756bc952e05" returned: 0 in 0.456s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-3af32d29-dbb2-4fcd-9483-4756bc952e05" released by "_delete_snapshot" :: held 2.506s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" released by "delete_snapshot" :: held 2.558s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Created reservations ['76c0597c-5ff2-4a2e-8289-ef0f160e1c8d', '5bc5e8fe-f06c-4dfd-95fe-5fea2c4c8f43', '6c3c2a7b-25f7-4080-adbd-d12491ee3739', '66bea691-123d-4527-947d-46b069f04e7e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Delete snapshot completed successfully. Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dcc1f6f6-691a-46a5-8ce9-6111347f1b19 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-3af32d29-dbb2-4fcd-9483-4756bc952e05-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-08b1742a-0c14-4ea4-bb52-3fb0350b3d13 tempest-VolumesActionsTest-2140818365 None] Terminate volume connection completed successfully. Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08b1742a-0c14-4ea4-bb52-3fb0350b3d13 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-detach_volume" by "detach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08b1742a-0c14-4ea4-bb52-3fb0350b3d13 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-08b1742a-0c14-4ea4-bb52-3fb0350b3d13 tempest-VolumesActionsTest-2140818365 None] Detaching volume f0f1ee05-8fdb-461f-be99-31f569558e72 from instance 3f7e383d-3cd6-4ced-bcac-8d67562f374d. Sep 09 14:49:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-08b1742a-0c14-4ea4-bb52-3fb0350b3d13 tempest-VolumesActionsTest-2140818365 None] Detach volume completed successfully. Sep 09 14:49:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08b1742a-0c14-4ea4-bb52-3fb0350b3d13 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ce6bebc-e04f-4ed3-bf81-fce91ae29d3e tempest-VolumesActionsTest-1974533787 None] Acquiring lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-detach_volume" by "detach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ce6bebc-e04f-4ed3-bf81-fce91ae29d3e tempest-VolumesActionsTest-1974533787 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0ce6bebc-e04f-4ed3-bf81-fce91ae29d3e tempest-VolumesActionsTest-1974533787 None] Volume detach called, but volume not attached. Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ce6bebc-e04f-4ed3-bf81-fce91ae29d3e tempest-VolumesActionsTest-1974533787 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Creating offline snapshot ad8602d0-4cd5-4a98-83ff-94a54b0f0aef of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f619e01-3da5-4e3c-b231-439332190907]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "cinder-quobyte-f0f1ee05-8fdb-461f-be99-31f569558e72" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:20 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:20 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-quobyte-f0f1ee05-8fdb-461f-be99-31f569558e72" acquired by "delete_volume" :: waited 0.048s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dc754f-af3a-45ad-8e2e-ffec869a3dca]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:21 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 Sep 09 14:49:21 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:21 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.517s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:21 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef 1G Sep 09 14:49:21 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:21 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72" returned: 0 in 0.683s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:21 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72 Sep 09 14:49:21 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (a68fd606-c9ad-4cb3-8f4e-599df39f81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a7c40a-d96c-458c-b697-49cb1057e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a7c40a-d96c-458c-b697-49cb1057e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884655474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9fb191-c393-471a-8d0a-2896f492a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:22Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd1d55a-895f-4f39-890b-5a8b1e23d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd1d55a-895f-4f39-890b-5a8b1e23d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aafb65b-e6dc-4f0b-9fa8-b58a7f6a7310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aafb65b-e6dc-4f0b-9fa8-b58a7f6a7310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9fb191-c393-471a-8d0a-2896f492a859', 'volume_name': 'volume-9b9fb191-c393-471a-8d0a-2896f492a859', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ded8cd7-85c8-4bc1-8fd3-6d4a6a8d6bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ded8cd7-85c8-4bc1-8fd3-6d4a6a8d6bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f8a3b6-95cf-49f4-9025-a1dbd5da31f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume 9b9fb191-c393-471a-8d0a-2896f492a859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9fb191-c393-471a-8d0a-2896f492a859', 'volume_size': 1} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:22 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef 1G" returned: 0 in 0.791s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:22 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef Sep 09 14:49:22 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:22 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f0f1ee05-8fdb-461f-be99-31f569558e72" returned: 0 in 0.490s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-quobyte-f0f1ee05-8fdb-461f-be99-31f569558e72" released by "delete_volume" :: held 1.295s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Created reservations ['b7de3e3f-a883-4af2-aa2d-35f87e604617', '29d5e2c8-67e7-4daf-b9df-bc4daa7a3e8c', 'd68d3134-fe3a-4cf1-8817-748ceb611698', '94a67b73-fb7d-4fe4-a013-f1e10327c66f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:22 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:22 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:22 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" returned: 0 in 0.432s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:22 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef is being set with open permissions: ugo+rw Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:22 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef Sep 09 14:49:22 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:22 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.476s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Deleted volume successfully. Sep 09 14:49:22 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884655474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9fb191-c393-471a-8d0a-2896f492a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:22Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Creating volume 9b9fb191-c393-471a-8d0a-2896f492a859 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:22 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-62ae1e6d-8f18-4d3b-8032-88ecc68630e4 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-f0f1ee05-8fdb-461f-be99-31f569558e72-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:23 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 1073741824 Sep 09 14:49:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-84ee75ae-7f60-46c3-8ea8-615dc0bc6f78 tempest-SnapshotsActionsTest-333444930 None] Create snapshot completed successfully Sep 09 14:49:23 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:23 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 1073741824" returned: 0 in 0.775s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:23 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 Sep 09 14:49:23 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-ad8602d0-4cd5-4a98-83ff-94a54b0f0aef-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:24 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-ad8602d0-4cd5-4a98-83ff-94a54b0f0aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f8a3b6-95cf-49f4-9025-a1dbd5da31f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9fb191-c393-471a-8d0a-2896f492a859', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec4490f-008c-43fe-8d76-cad29ca4b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Acquiring lock "cinder-quobyte-ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume volume-9b9fb191-c393-471a-8d0a-2896f492a859 (9b9fb191-c393-471a-8d0a-2896f492a859): created successfully Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec4490f-008c-43fe-8d76-cad29ca4b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (a68fd606-c9ad-4cb3-8f4e-599df39f81f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Deleting offline snapshot ad8602d0-4cd5-4a98-83ff-94a54b0f0aef of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] snapshot_file for this snap is: volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:49:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9806d6d3-800d-41ec-9e9e-513b5417acda tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created volume successfully. Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[130eaf7b-ede1-4034-9cd8-d5d748b2f788]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:24 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef Sep 09 14:49:24 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:24 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" returned: 0 in 0.553s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b3f91-4b13-47ac-8b0f-7027ad371242]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:25 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:25 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:25 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.556s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:25 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef Sep 09 14:49:25 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (d9d258e3-da88-47a3-ad25-6c7bba8ef210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77db49ef-6e00-46fe-9f19-0f2dec7da840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77db49ef-6e00-46fe-9f19-0f2dec7da840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31705791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9395467-56cf-4443-a0ec-0777260a2c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:26Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b3b45b-7721-4e20-abf3-3ea7cbc2da27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b3b45b-7721-4e20-abf3-3ea7cbc2da27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c474183-6bde-4107-9f4e-e7296d9d5c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c474183-6bde-4107-9f4e-e7296d9d5c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9395467-56cf-4443-a0ec-0777260a2c1e', 'volume_name': 'volume-f9395467-56cf-4443-a0ec-0777260a2c1e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068abf45-4082-41cc-bf2a-a7867555882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068abf45-4082-41cc-bf2a-a7867555882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85bffd6-2c6e-4cee-850e-2fd2ea06559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume f9395467-56cf-4443-a0ec-0777260a2c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9395467-56cf-4443-a0ec-0777260a2c1e', 'volume_size': 1} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31705791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9395467-56cf-4443-a0ec-0777260a2c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:26Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Creating volume f9395467-56cf-4443-a0ec-0777260a2c1e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:25 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:25 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e 1073741824 Sep 09 14:49:25 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:26 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" returned: 0 in 0.614s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:26 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef Sep 09 14:49:26 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:26 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" returned: 0 in 0.308s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-ad8602d0-4cd5-4a98-83ff-94a54b0f0aef" released by "_delete_snapshot" :: held 2.208s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" released by "delete_snapshot" :: held 2.263s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (c9546039-feef-41df-80cf-b7602a0b22e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea79bf1c-3f51-4abb-b9a9-b022bb928bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea79bf1c-3f51-4abb-b9a9-b022bb928bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-516845186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730d175c-5f8f-4a99-a0be-876d53679ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:26Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77b5e6e-edb1-438c-86bd-79f4650d2cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77b5e6e-edb1-438c-86bd-79f4650d2cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8671b69d-d054-4487-81fa-0cd641fa2c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8671b69d-d054-4487-81fa-0cd641fa2c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730d175c-5f8f-4a99-a0be-876d53679ceb', 'volume_name': 'volume-730d175c-5f8f-4a99-a0be-876d53679ceb', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761eb11b-89bb-4d8d-82f7-e0e63ca5d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761eb11b-89bb-4d8d-82f7-e0e63ca5d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a331b327-c469-4846-b2ba-16ef03692be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume 730d175c-5f8f-4a99-a0be-876d53679ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730d175c-5f8f-4a99-a0be-876d53679ceb', 'volume_size': 1} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Created reservations ['56294e72-e462-446c-a997-681e3ddabf0c', 'a29ca4a3-620b-49b9-8b2c-f08bae196d3e', '79a7cb7c-6303-4afb-8357-5864ac7ee75e', '8e27741b-e2bf-4929-8c93-836c893f3479'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:26 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e 1073741824" returned: 0 in 0.816s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Delete snapshot completed successfully. Sep 09 14:49:26 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e Sep 09 14:49:26 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49b23488-b5c7-4728-9fb7-4cf0ed933613 tempest-SnapshotsActionsTest-1762965926 None] Lock "cinder-ad8602d0-4cd5-4a98-83ff-94a54b0f0aef-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:26 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (02c7876f-437e-437b-9e9f-373e4c732d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d14b2e-664e-48e7-a3df-ec6c82c76864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d14b2e-664e-48e7-a3df-ec6c82c76864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-450129608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3272bb64-2820-47eb-918f-f8c4ea48d325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:27Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e30094-ad99-4ae0-a596-1b39b9288f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e30094-ad99-4ae0-a596-1b39b9288f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d17edf-3969-45da-b3af-b36224fc4e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d17edf-3969-45da-b3af-b36224fc4e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3272bb64-2820-47eb-918f-f8c4ea48d325', 'volume_name': 'volume-3272bb64-2820-47eb-918f-f8c4ea48d325', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f968d9-55a3-41ed-a40f-ec21522a3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f968d9-55a3-41ed-a40f-ec21522a3e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8d93c6-2a7d-42fd-ad08-7ddca4407175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Volume 3272bb64-2820-47eb-918f-f8c4ea48d325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3272bb64-2820-47eb-918f-f8c4ea48d325', 'volume_size': 1} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:27 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (c797af10-1ddb-4285-8615-32f85ad3b68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c241bc4d-03e6-4155-8eba-2f9e54bb0d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e" returned: 0 in 0.537s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-516845186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730d175c-5f8f-4a99-a0be-876d53679ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:26Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Creating volume 730d175c-5f8f-4a99-a0be-876d53679ceb {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c241bc4d-03e6-4155-8eba-2f9e54bb0d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009970622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64fad85-8924-4645-b053-fb20edc20619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:27Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b4c3c3-c1df-4134-86b7-90c747126b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b4c3c3-c1df-4134-86b7-90c747126b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69571137-2c75-4898-98ea-398c222f0ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb 1073741824 Sep 09 14:49:27 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69571137-2c75-4898-98ea-398c222f0ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64fad85-8924-4645-b053-fb20edc20619', 'volume_name': 'volume-f64fad85-8924-4645-b053-fb20edc20619', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f110ef-3652-4333-b04b-6a98fe409370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f110ef-3652-4333-b04b-6a98fe409370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d79933-eefa-4fee-97a3-01af9446f15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume f64fad85-8924-4645-b053-fb20edc20619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64fad85-8924-4645-b053-fb20edc20619', 'volume_size': 1} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85bffd6-2c6e-4cee-850e-2fd2ea06559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9395467-56cf-4443-a0ec-0777260a2c1e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84876c5-de2c-4828-a2b3-08bd1c1d83b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume volume-f9395467-56cf-4443-a0ec-0777260a2c1e (f9395467-56cf-4443-a0ec-0777260a2c1e): created successfully Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84876c5-de2c-4828-a2b3-08bd1c1d83b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (d9d258e3-da88-47a3-ad25-6c7bba8ef210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d0771d6f-f947-4191-9b6e-0ee5f6f74df2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created volume successfully. Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (23480ec2-ca69-4e08-932e-78f5141c053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20b66e4-be68-4cbf-ad50-9a054156e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20b66e4-be68-4cbf-ad50-9a054156e453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142259696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294775c8-d95d-4f1a-b8e4-06b43a7c1af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:27Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0d0b85-3f32-4006-9324-6c860904d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0d0b85-3f32-4006-9324-6c860904d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2bbec7-d8bb-41aa-aec8-2e880f215994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2bbec7-d8bb-41aa-aec8-2e880f215994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294775c8-d95d-4f1a-b8e4-06b43a7c1af1', 'volume_name': 'volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa6b7a0-da27-4c05-950f-9d0e1fe6c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa6b7a0-da27-4c05-950f-9d0e1fe6c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d280d03-468c-4d64-badc-263481c52188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume 294775c8-d95d-4f1a-b8e4-06b43a7c1af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1', 'volume_size': 1} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:27 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb 1073741824" returned: 0 in 0.558s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (53a60019-f41e-49c9-8739-8ddcd9ac878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128197d2-f3b6-4382-94f8-8ee0192a2a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128197d2-f3b6-4382-94f8-8ee0192a2a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728722682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:28Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dd24d4-bb2a-469b-8661-bdb1d2e2bf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dd24d4-bb2a-469b-8661-bdb1d2e2bf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9bf79e-fe89-4811-817a-53a677f21822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9bf79e-fe89-4811-817a-53a677f21822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d', 'volume_name': 'volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2569ae-0b41-45c0-9990-d8abfa7c36fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2569ae-0b41-45c0-9990-d8abfa7c36fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da9325f-2805-4d39-bb42-3cf347b02fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume 1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d', 'volume_size': 1} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:27 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb Sep 09 14:49:27 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "cinder-c2dace30-e1b8-48d8-879c-2e156017a682-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-c2dace30-e1b8-48d8-879c-2e156017a682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "cinder-quobyte-c2dace30-e1b8-48d8-879c-2e156017a682" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-quobyte-c2dace30-e1b8-48d8-879c-2e156017a682" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Deleting offline snapshot c2dace30-e1b8-48d8-879c-2e156017a682 of volume a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] snapshot_file for this snap is: volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5a9c1-921b-4263-8619-68625c168f33]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:28 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb" returned: 0 in 0.259s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-450129608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3272bb64-2820-47eb-918f-f8c4ea48d325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:27Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Creating volume 3272bb64-2820-47eb-918f-f8c4ea48d325 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:28 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a331b327-c469-4846-b2ba-16ef03692be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730d175c-5f8f-4a99-a0be-876d53679ceb', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af5c9d7-c2ef-44cb-bdc7-7c440a8a8444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:28 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 1073741824 Sep 09 14:49:28 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:28 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume volume-730d175c-5f8f-4a99-a0be-876d53679ceb (730d175c-5f8f-4a99-a0be-876d53679ceb): created successfully Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af5c9d7-c2ef-44cb-bdc7-7c440a8a8444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (c9546039-feef-41df-80cf-b7602a0b22e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-599fa2d0-2511-4bff-9738-cb0ccc417671 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created volume successfully. Sep 09 14:49:28 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:28 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:28 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.379s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d5fe88-5eda-4eee-96ed-e088360c371c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95db7db2-026a-4f78-ad3c-4eb7ddb3503d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:28 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 1073741824" returned: 0 in 0.432s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:28 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c Sep 09 14:49:28 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:28 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 Sep 09 14:49:28 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:28 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009970622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64fad85-8924-4645-b053-fb20edc20619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:27Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Creating volume f64fad85-8924-4645-b053-fb20edc20619 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:28 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:28 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8d93c6-2a7d-42fd-ad08-7ddca4407175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3272bb64-2820-47eb-918f-f8c4ea48d325', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:29 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 1073741824 Sep 09 14:49:29 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40edb68-04ad-45fc-b48b-33b6e953378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:29 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Volume volume-3272bb64-2820-47eb-918f-f8c4ea48d325 (3272bb64-2820-47eb-918f-f8c4ea48d325): created successfully Sep 09 14:49:29 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40edb68-04ad-45fc-b48b-33b6e953378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:29 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (02c7876f-437e-437b-9e9f-373e4c732d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-763358b2-fe37-4878-9bc0-45840e881d90 tempest-VolumesActionsTest-1974533787 None] Created volume successfully. Sep 09 14:49:29 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.362s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:29 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 1073741824" returned: 0 in 0.410s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:29 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682 Sep 09 14:49:29 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:29 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 Sep 09 14:49:29 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:29 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c.c2dace30-e1b8-48d8-879c-2e156017a682" returned: 0 in 0.255s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:29 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-quobyte-c2dace30-e1b8-48d8-879c-2e156017a682" released by "_delete_snapshot" :: held 1.513s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619" returned: 0 in 0.250s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" released by "delete_snapshot" :: held 1.537s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.124s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2142259696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294775c8-d95d-4f1a-b8e4-06b43a7c1af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:27Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Creating volume 294775c8-d95d-4f1a-b8e4-06b43a7c1af1 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:29 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:29 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 1073741824 Sep 09 14:49:29 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d79933-eefa-4fee-97a3-01af9446f15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64fad85-8924-4645-b053-fb20edc20619', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c28f64-f135-4cb0-84af-046f371d07b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:29 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume volume-f64fad85-8924-4645-b053-fb20edc20619 (f64fad85-8924-4645-b053-fb20edc20619): created successfully Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c28f64-f135-4cb0-84af-046f371d07b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (c797af10-1ddb-4285-8615-32f85ad3b68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5db69380-2b34-4242-afb8-6db5eb41a0d0 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created volume successfully. Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Created reservations ['106accfb-6e17-47f4-8094-6d7c9101ef74', 'bebb8a3d-9a0d-4384-b7e9-7381c4c591d2', 'b58c95eb-5dbe-48ac-8ba6-1a02091514ac', '47515d6a-bafd-4dc0-a7f0-2461027368f7'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Delete snapshot completed successfully. Sep 09 14:49:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0610296-5d95-4de3-9229-22745038c69d tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-c2dace30-e1b8-48d8-879c-2e156017a682-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-3272bb64-2820-47eb-918f-f8c4ea48d325-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Lock "cinder-3272bb64-2820-47eb-918f-f8c4ea48d325-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:30 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 1073741824" returned: 0 in 0.513s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-quobyte-3272bb64-2820-47eb-918f-f8c4ea48d325" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-3272bb64-2820-47eb-918f-f8c4ea48d325" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a5907-3885-43e3-a99d-ad48f1abee93]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:30 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 Sep 09 14:49:30 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "cinder-a5d5fe88-5eda-4eee-96ed-e088360c371c-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:30 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 Sep 09 14:49:30 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-a5d5fe88-5eda-4eee-96ed-e088360c371c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52696d-a555-4c05-9507-a21fc2258896]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:30 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.633s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728722682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76b913a2f274aa295edcae0b83f9b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:28Z,use_quota=True,user_id='c0a6665d0cdd4a62b7cad0d12b13d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Creating volume 1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:30 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d280d03-468c-4d64-badc-263481c52188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb225588-6399-4486-9155-a0c54ef0c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:30 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d 1073741824 Sep 09 14:49:30 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:30 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 (294775c8-d95d-4f1a-b8e4-06b43a7c1af1): created successfully Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb225588-6399-4486-9155-a0c54ef0c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:30 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c Sep 09 14:49:30 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (23480ec2-ca69-4e08-932e-78f5141c053b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9459aaf7-29d2-4758-a8d1-d1f47f133ec2 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created volume successfully. Sep 09 14:49:30 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:30 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325 Sep 09 14:49:30 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:30 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:30 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c Sep 09 14:49:30 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:30 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3272bb64-2820-47eb-918f-f8c4ea48d325" returned: 0 in 0.264s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-3272bb64-2820-47eb-918f-f8c4ea48d325" released by "delete_volume" :: held 0.764s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Created reservations ['7f6cd1ca-503f-4b63-b471-4d3a3edea60f', 'aad436e7-6cf3-4e88-8246-aa73819695fe', '9bd3a669-3546-42d0-beb2-7ba2c464a28f', '956a3306-7e41-4117-8cb6-5bc3b9d72fb4'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:31 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d 1073741824" returned: 0 in 0.501s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:31 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:31 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:31 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d Sep 09 14:49:31 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:31 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a5d5fe88-5eda-4eee-96ed-e088360c371c" returned: 0 in 0.321s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-quobyte-a5d5fe88-5eda-4eee-96ed-e088360c371c" released by "delete_volume" :: held 0.793s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Created reservations ['f7b8e07d-612b-42bc-9fce-5b1761a31ec5', '5bc45ebc-e173-4b8f-aaf5-31ef87fb5a40', '79ec825d-a78f-4135-9b3d-1e4d9eed17fe', 'a628f45a-6a08-4ce3-8dc2-8c92a87fe80a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:31 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:31 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.311s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:31 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:31 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da9325f-2805-4d39-bb42-3cf347b02fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973c10a-16ec-4a65-8f22-2421e391c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Deleted volume successfully. Sep 09 14:49:31 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Volume volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d (1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d): created successfully Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973c10a-16ec-4a65-8f22-2421e391c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Flow 'volume_create_manager' (53a60019-f41e-49c9-8739-8ddcd9ac878c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8811133c-08a1-45b0-b061-f9efdfcaf00d tempest-VolumesActionsTest-2140818365 None] Lock "cinder-3272bb64-2820-47eb-918f-f8c4ea48d325-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b0fb2661-0163-4d22-b8c2-b1a1921281b7 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created volume successfully. Sep 09 14:49:31 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Deleted volume successfully. Sep 09 14:49:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d1a2e4a2-66fd-45c7-870b-20f4c036e561 tempest-SnapshotsActionsTest-333444930 None] Lock "cinder-a5d5fe88-5eda-4eee-96ed-e088360c371c-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (f4194ace-2869-4e48-9658-f964157c0d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa066ca-2a25-4222-805c-f9c0cb702e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa066ca-2a25-4222-805c-f9c0cb702e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013128193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4deb41a-8cda-418f-b213-950dacdfd276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:32Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245b2a25-0aed-42d7-8e60-20b8c541b463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245b2a25-0aed-42d7-8e60-20b8c541b463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8700c8-90af-4be9-a080-c8e1785a9e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8700c8-90af-4be9-a080-c8e1785a9e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4deb41a-8cda-418f-b213-950dacdfd276', 'volume_name': 'volume-d4deb41a-8cda-418f-b213-950dacdfd276', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b255985-a733-4a6d-94e3-7dee78c6dbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b255985-a733-4a6d-94e3-7dee78c6dbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e0542e-d03b-444b-8f28-50c267fc8fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:32 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Volume d4deb41a-8cda-418f-b213-950dacdfd276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4deb41a-8cda-418f-b213-950dacdfd276', 'volume_size': 1} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013128193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4deb41a-8cda-418f-b213-950dacdfd276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:32Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Creating volume d4deb41a-8cda-418f-b213-950dacdfd276 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:32 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:32 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 1073741824 Sep 09 14:49:32 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-quobyte-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e44200-287d-4e3e-a004-3e2bf615eb5d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:32 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d Sep 09 14:49:32 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:32 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 1073741824" returned: 0 in 0.592s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:33 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d" returned: 0 in 0.492s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:33 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 Sep 09 14:49:33 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:33 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d Sep 09 14:49:33 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:33 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276" returned: 0 in 0.329s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e0542e-d03b-444b-8f28-50c267fc8fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4deb41a-8cda-418f-b213-950dacdfd276', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b704f2-0ac7-4a5f-8a31-97f1f20c7ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:33 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Volume volume-d4deb41a-8cda-418f-b213-950dacdfd276 (d4deb41a-8cda-418f-b213-950dacdfd276): created successfully Sep 09 14:49:33 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b704f2-0ac7-4a5f-8a31-97f1f20c7ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (f4194ace-2869-4e48-9658-f964157c0d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d" returned: 0 in 0.352s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d" released by "delete_volume" :: held 0.898s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-18716a89-1f6a-4b5e-bfe5-6560ecc8a72c tempest-VolumesActionsTest-1974533787 None] Created volume successfully. Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created reservations ['a08493fd-d392-4fe3-85ae-63bc3c29e134', 'c57ce942-756b-4e11-8874-09effc4f84e6', 'ddede2bd-4ac7-419c-a5aa-6a66471a1752', '078d30a4-413b-443a-92bd-b8e1e62c6533'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:33 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:33 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-294775c8-d95d-4f1a-b8e4-06b43a7c1af1-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-294775c8-d95d-4f1a-b8e4-06b43a7c1af1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-quobyte-294775c8-d95d-4f1a-b8e4-06b43a7c1af1" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-294775c8-d95d-4f1a-b8e4-06b43a7c1af1" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[acba4320-00bb-41b6-968c-d8d2399a0a97]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:34 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 Sep 09 14:49:34 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:34 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.393s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Deleted volume successfully. Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4e252a3d-1d74-4754-bb12-d984b199043a tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-1ae496e4-d3e4-4d60-8a58-6ca0598dcb3d-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:34 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1" returned: 0 in 0.532s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:34 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1 Sep 09 14:49:34 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-d4deb41a-8cda-418f-b213-950dacdfd276-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-d4deb41a-8cda-418f-b213-950dacdfd276-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-quobyte-d4deb41a-8cda-418f-b213-950dacdfd276" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-d4deb41a-8cda-418f-b213-950dacdfd276" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:34 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-294775c8-d95d-4f1a-b8e4-06b43a7c1af1" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5d6c8-a6ec-4ed5-9f21-276f206d4847]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-294775c8-d95d-4f1a-b8e4-06b43a7c1af1" released by "delete_volume" :: held 0.969s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created reservations ['38e0bcad-302d-42d2-8c83-d102bd3d3eaf', '19441e7e-c9f0-41f2-8825-77e5f295af84', 'ce12d2d4-af03-4986-91d7-059bf7a8d321', '99b1327d-6fe7-4c98-9e49-7d6cde362d19'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:34 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 Sep 09 14:49:34 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:35 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:35 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-f64fad85-8924-4645-b053-fb20edc20619-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-f64fad85-8924-4645-b053-fb20edc20619-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-quobyte-f64fad85-8924-4645-b053-fb20edc20619" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-f64fad85-8924-4645-b053-fb20edc20619" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[698c2544-bf1d-46db-a782-5badad74bcc4]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:35 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276" returned: 0 in 0.547s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:35 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276 Sep 09 14:49:35 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:35 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.426s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:35 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 Sep 09 14:49:35 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Deleted volume successfully. Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e18dfe42-094f-4b94-9f7f-5e321a78ec08 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-294775c8-d95d-4f1a-b8e4-06b43a7c1af1-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:35 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d4deb41a-8cda-418f-b213-950dacdfd276" returned: 0 in 0.361s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-d4deb41a-8cda-418f-b213-950dacdfd276" released by "delete_volume" :: held 0.967s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:35 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619" returned: 0 in 0.457s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:35 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619 Sep 09 14:49:35 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Created reservations ['3e13a2da-c434-4efd-b88d-e984640862df', '9d600be0-c9e1-475a-89d9-a7d0d8f990d6', 'ddf14a8e-c52f-483a-b1a2-52d158d67c04', 'd7e58398-d355-4f95-a4ab-db3a531e0895'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:35 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:35 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:36 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f64fad85-8924-4645-b053-fb20edc20619" returned: 0 in 0.342s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-f64fad85-8924-4645-b053-fb20edc20619" released by "delete_volume" :: held 0.861s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created reservations ['c8a1fbb2-5f8d-4818-b71b-db608c5cc029', '6493d2bf-f240-4320-8e60-5ee7383b8553', 'f18c80ea-ae5c-45ac-8d3a-f05db9e35d63', 'e1ef5c6c-0609-45e8-b31d-20f206f4106c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:36 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:36 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Deleted volume successfully. Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-225932a2-1cbe-4215-bef4-820f7210d343 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-d4deb41a-8cda-418f-b213-950dacdfd276-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:36 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:36 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:36 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.271s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:36 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Deleted volume successfully. Sep 09 14:49:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415aaabb-e54b-4be4-9e09-d023d7f18294 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-f64fad85-8924-4645-b053-fb20edc20619-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-730d175c-5f8f-4a99-a0be-876d53679ceb-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-730d175c-5f8f-4a99-a0be-876d53679ceb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-quobyte-730d175c-5f8f-4a99-a0be-876d53679ceb" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-730d175c-5f8f-4a99-a0be-876d53679ceb" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96bb70a-d73d-4a0b-a0e8-c608d3386895]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (23882c0f-1dcb-4f6a-87e2-67f0282598de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87160bf7-adf8-452f-a192-debb986e9c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87160bf7-adf8-452f-a192-debb986e9c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1685155311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ec51d0-710e-4b51-9335-1dd228b0a027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:38Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce44780-8b06-46ac-a9aa-76789b1bdacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce44780-8b06-46ac-a9aa-76789b1bdacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185e634d-1a80-4901-b6f7-53837cd4f0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:37 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb Sep 09 14:49:37 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185e634d-1a80-4901-b6f7-53837cd4f0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ec51d0-710e-4b51-9335-1dd228b0a027', 'volume_name': 'volume-57ec51d0-710e-4b51-9335-1dd228b0a027', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881cadcc-003c-410f-a7c3-139cd2116886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881cadcc-003c-410f-a7c3-139cd2116886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8835fd6-58a4-43f3-ac8a-1f97261a8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:37 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Volume 57ec51d0-710e-4b51-9335-1dd228b0a027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ec51d0-710e-4b51-9335-1dd228b0a027', 'volume_size': 1} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1685155311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ec51d0-710e-4b51-9335-1dd228b0a027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:38Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Creating volume 57ec51d0-710e-4b51-9335-1dd228b0a027 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:37 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:37 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 1073741824 Sep 09 14:49:37 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:38 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb" returned: 0 in 0.442s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:38 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb Sep 09 14:49:38 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:38 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 1073741824" returned: 0 in 0.548s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:38 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-730d175c-5f8f-4a99-a0be-876d53679ceb" returned: 0 in 0.277s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-730d175c-5f8f-4a99-a0be-876d53679ceb" released by "delete_volume" :: held 0.781s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:38 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 Sep 09 14:49:38 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created reservations ['b2fbcbf6-0a94-4338-aa38-472f04b240c2', '789bcfe6-ba1e-42ba-90c7-015d37e1bc05', '3bb9b2ec-c0ff-4c58-8436-133a290c7bc4', '6ddf4e2d-aa2f-498e-a3fc-b844c09775f1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:38 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:38 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-f9395467-56cf-4443-a0ec-0777260a2c1e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-f9395467-56cf-4443-a0ec-0777260a2c1e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:38 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027" returned: 0 in 0.477s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-quobyte-f9395467-56cf-4443-a0ec-0777260a2c1e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8835fd6-58a4-43f3-ac8a-1f97261a8bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ec51d0-710e-4b51-9335-1dd228b0a027', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ed3670-d97f-440d-b876-e52370b91de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-f9395467-56cf-4443-a0ec-0777260a2c1e" acquired by "delete_volume" :: waited 0.054s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Volume volume-57ec51d0-710e-4b51-9335-1dd228b0a027 (57ec51d0-710e-4b51-9335-1dd228b0a027): created successfully Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ed3670-d97f-440d-b876-e52370b91de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (23882c0f-1dcb-4f6a-87e2-67f0282598de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9a56a-96d1-4c79-a091-ac98610a2c64]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:38 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.420s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Deleted volume successfully. Sep 09 14:49:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-076d144f-ca1f-47ab-8a90-f4007da55f38 tempest-VolumesActionsTest-1974533787 None] Created volume successfully. Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-18016d6b-d074-40dc-818a-9dc1a7266aa8 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-730d175c-5f8f-4a99-a0be-876d53679ceb-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:39 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e Sep 09 14:49:39 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:39 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e" returned: 0 in 0.430s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:39 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e Sep 09 14:49:39 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:39 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f9395467-56cf-4443-a0ec-0777260a2c1e" returned: 0 in 0.420s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-f9395467-56cf-4443-a0ec-0777260a2c1e" released by "delete_volume" :: held 0.952s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:39 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created reservations ['dbe197f3-d330-4571-bd23-f6277124d2ee', '5a4641b1-23f5-4aca-a742-61fa6ea3e30b', 'b6df968d-fa59-4d56-b0b6-e1bd1d69d7f7', '24323f10-ab51-48c4-aea3-e5e86753614c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:40 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:40 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-57ec51d0-710e-4b51-9335-1dd228b0a027-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-57ec51d0-710e-4b51-9335-1dd228b0a027-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-5e3f6cc6-1f0a-4f29-b8cd-74ce4ec97558 req-29ba9c5a-10c7-487d-8b60-f60b65eceaa4 tempest-TestShelveInstance-1499452957 None] Terminate volume connection completed successfully. Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-5e3f6cc6-1f0a-4f29-b8cd-74ce4ec97558 req-29ba9c5a-10c7-487d-8b60-f60b65eceaa4 tempest-TestShelveInstance-1499452957 None] Deleting attachment dc473b50-dbe6-45e2-a1ed-fd8efbc49c26. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:49:40 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.310s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Deleted volume successfully. Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-quobyte-57ec51d0-710e-4b51-9335-1dd228b0a027" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6e9199e1-6611-405f-bf4f-b1f87768de1f tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-f9395467-56cf-4443-a0ec-0777260a2c1e-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-57ec51d0-710e-4b51-9335-1dd228b0a027" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d14ab8c-40d9-49b5-ab97-41a9ee4fb1c8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:40 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 Sep 09 14:49:40 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Flow 'volume_create_manager' (3deda80e-9992-4b6d-8f95-a0ad22bab0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591756f4-c006-4433-84c9-380f1f6f756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591756f4-c006-4433-84c9-380f1f6f756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1673558761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83e78ca-7b02-4855-87d9-4d2aef9ce55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189eee0e84aa482e93f74740ebf9e086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:41Z,use_quota=True,user_id='9a77af447f7c4fafa0a374e7b270abdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32b56a9-404a-4101-b40a-6a49c265b391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32b56a9-404a-4101-b40a-6a49c265b391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13dbb54-3fd7-4c4f-8a4a-0a04327146c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13dbb54-3fd7-4c4f-8a4a-0a04327146c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83e78ca-7b02-4855-87d9-4d2aef9ce55e', 'volume_name': 'volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e541ce-26a3-4b28-8e13-4a62935c1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e541ce-26a3-4b28-8e13-4a62935c1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843122b2-2d6c-41a3-b5dd-2b85ac863bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Volume c83e78ca-7b02-4855-87d9-4d2aef9ce55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e', 'volume_size': 1} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1673558761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83e78ca-7b02-4855-87d9-4d2aef9ce55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189eee0e84aa482e93f74740ebf9e086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:41Z,use_quota=True,user_id='9a77af447f7c4fafa0a374e7b270abdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Creating volume c83e78ca-7b02-4855-87d9-4d2aef9ce55e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:40 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:40 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e 1073741824 Sep 09 14:49:40 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:40 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027" returned: 0 in 0.451s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:40 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027 Sep 09 14:49:40 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-9b9fb191-c393-471a-8d0a-2896f492a859-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-9b9fb191-c393-471a-8d0a-2896f492a859-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "cinder-quobyte-9b9fb191-c393-471a-8d0a-2896f492a859" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:41 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-57ec51d0-710e-4b51-9335-1dd228b0a027" returned: 0 in 0.278s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-9b9fb191-c393-471a-8d0a-2896f492a859" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-57ec51d0-710e-4b51-9335-1dd228b0a027" released by "delete_volume" :: held 0.799s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[54568c8a-c68b-42fd-ac67-2aa073b2db0c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Created reservations ['4a8c290b-42c8-4bb3-9d98-f2dd6450b859', 'f6e9745e-0300-4488-afb0-49d00b935240', '042e73c9-ec5d-4b24-8157-fc8b94bf6d03', '95262ac6-49e4-4376-9ecc-de91f2354e9c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:41 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 Sep 09 14:49:41 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:41 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e 1073741824" returned: 0 in 0.583s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:41 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:41 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:41 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e Sep 09 14:49:41 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:41 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859" returned: 0 in 0.510s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:41 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859 Sep 09 14:49:41 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:41 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.370s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:41 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e" returned: 0 in 0.370s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Deleted volume successfully. Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843122b2-2d6c-41a3-b5dd-2b85ac863bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61edb09-b696-4b57-89da-5e7689fae2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-632c699e-4b6d-4885-9508-86b161a5e6a3 tempest-VolumesActionsTest-2140818365 None] Lock "cinder-57ec51d0-710e-4b51-9335-1dd228b0a027-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:41 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Volume volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e (c83e78ca-7b02-4855-87d9-4d2aef9ce55e): created successfully Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61edb09-b696-4b57-89da-5e7689fae2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Flow 'volume_create_manager' (3deda80e-9992-4b6d-8f95-a0ad22bab0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e7b49425-7b54-4cbf-80e1-d3c663a1d70e tempest-VolumeQuotasAdminTestJSON-542027729 None] Created volume successfully. Sep 09 14:49:42 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9b9fb191-c393-471a-8d0a-2896f492a859" returned: 0 in 0.336s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-quobyte-9b9fb191-c393-471a-8d0a-2896f492a859" released by "delete_volume" :: held 0.897s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Created reservations ['eedc01c5-a8b6-477a-8746-529a4831a76f', 'e96cd4af-28bf-41b3-a647-8f883fcd3659', '2fa631ca-ccc3-4dba-8ff2-7e0c9d96b723', 'c01f528d-5e3d-453a-baf0-43204d6d0c17'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:42 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:42 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (016a6d46-fc89-449e-aa83-156d73823bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094bcde3-685a-4e1d-b447-a4baad1f6b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094bcde3-685a-4e1d-b447-a4baad1f6b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1962807515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c87dce3-a398-47c0-9f83-fde182a07f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:42Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4609229-23a0-4624-899c-3c59fc22b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4609229-23a0-4624-899c-3c59fc22b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4066f61-06d1-42e0-8672-d2b500b119b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4066f61-06d1-42e0-8672-d2b500b119b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c87dce3-a398-47c0-9f83-fde182a07f59', 'volume_name': 'volume-9c87dce3-a398-47c0-9f83-fde182a07f59', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0a16bd-4ac2-4be8-80e7-7d0f4bc8475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0a16bd-4ac2-4be8-80e7-7d0f4bc8475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea9ff50-602d-4c5c-85db-07233662ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Volume 9c87dce3-a398-47c0-9f83-fde182a07f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c87dce3-a398-47c0-9f83-fde182a07f59', 'volume_size': 1} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1962807515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c87dce3-a398-47c0-9f83-fde182a07f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:42Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Creating volume 9c87dce3-a398-47c0-9f83-fde182a07f59 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:42 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 1073741824 Sep 09 14:49:42 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:42 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.439s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Deleted volume successfully. Sep 09 14:49:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97847821-845a-440b-a723-3b789dcf6050 tempest-CreateVolumesFromSourceVolumeTest-97233967 None] Lock "cinder-9b9fb191-c393-471a-8d0a-2896f492a859-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "cinder-c83e78ca-7b02-4855-87d9-4d2aef9ce55e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "cinder-c83e78ca-7b02-4855-87d9-4d2aef9ce55e-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "cinder-quobyte-c83e78ca-7b02-4855-87d9-4d2aef9ce55e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:43 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 1073741824" returned: 0 in 0.642s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "cinder-quobyte-c83e78ca-7b02-4855-87d9-4d2aef9ce55e" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc5faa8-8263-486c-bf94-6d7ce80f8612]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:43 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 Sep 09 14:49:43 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:43 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e Sep 09 14:49:43 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:43 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59" returned: 0 in 0.326s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea9ff50-602d-4c5c-85db-07233662ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c87dce3-a398-47c0-9f83-fde182a07f59', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59b4959-98d4-4372-a465-97d6511c42af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Volume volume-9c87dce3-a398-47c0-9f83-fde182a07f59 (9c87dce3-a398-47c0-9f83-fde182a07f59): created successfully Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59b4959-98d4-4372-a465-97d6511c42af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (016a6d46-fc89-449e-aa83-156d73823bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:43 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e0867425-db6d-4268-a43b-b1a398dbf00b tempest-VolumesActionsTest-1974533787 None] Created volume successfully. Sep 09 14:49:43 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e" returned: 0 in 0.472s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:43 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e Sep 09 14:49:43 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:44 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c83e78ca-7b02-4855-87d9-4d2aef9ce55e" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "cinder-quobyte-c83e78ca-7b02-4855-87d9-4d2aef9ce55e" released by "delete_volume" :: held 0.886s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Created reservations ['17d1b308-f068-41d7-b49f-ce283ba7c24f', '7df03b80-c2e9-4842-a4e1-7e33760a9614', 'e3a77bff-5fa3-4979-b3ba-9cb45ff1eb3a', 'e799e516-cced-46af-bb9e-d8a7da51df79'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8a0e4104-17da-461d-bbfb-21de7cd57eb9 req-37973a27-06fa-4dee-84db-644ba1a803ff tempest-TestShelveInstance-1499452957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8a0e4104-17da-461d-bbfb-21de7cd57eb9 req-37973a27-06fa-4dee-84db-644ba1a803ff tempest-TestShelveInstance-1499452957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8a0e4104-17da-461d-bbfb-21de7cd57eb9 req-37973a27-06fa-4dee-84db-644ba1a803ff tempest-TestShelveInstance-1499452957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-8a0e4104-17da-461d-bbfb-21de7cd57eb9 req-37973a27-06fa-4dee-84db-644ba1a803ff tempest-TestShelveInstance-1499452957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-82755c24-e3e0-4696-95c7-963fdea77278', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3951467-7435-4509-97bd-76325d0464e5', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:44 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:44 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-8a0e4104-17da-461d-bbfb-21de7cd57eb9 req-37973a27-06fa-4dee-84db-644ba1a803ff tempest-TestShelveInstance-1499452957 None] attachment_update completed successfully. Sep 09 14:49:44 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Deleted volume successfully. Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e19cc93-9125-4a1d-818e-9e2b4cfb9256 tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "cinder-c83e78ca-7b02-4855-87d9-4d2aef9ce55e-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-9c87dce3-a398-47c0-9f83-fde182a07f59-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Lock "cinder-9c87dce3-a398-47c0-9f83-fde182a07f59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Acquiring lock "cinder-quobyte-9c87dce3-a398-47c0-9f83-fde182a07f59" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-9c87dce3-a398-47c0-9f83-fde182a07f59" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ad03c-9b61-46d6-9e82-42dfe39edc97]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:44 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 Sep 09 14:49:44 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:45 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:45 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59 Sep 09 14:49:45 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:45 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9c87dce3-a398-47c0-9f83-fde182a07f59" returned: 0 in 0.345s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Lock "cinder-quobyte-9c87dce3-a398-47c0-9f83-fde182a07f59" released by "delete_volume" :: held 0.843s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Created reservations ['1caaa285-876b-4705-823f-3cc27e853273', '3673e05b-b4a4-4099-b692-1e053e0857c0', 'a5fff8fb-7b64-4023-b30b-fdb06d8cc8ae', '9c64155b-c0c8-44ed-bf74-fb1185725012'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:45 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:45 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Flow 'volume_create_manager' (9cc82702-7f94-4917-b37e-b79f16a1a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff00149-d3ed-42b7-bea6-33a03ff50497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff00149-d3ed-42b7-bea6-33a03ff50497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1702066693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d41314-4cb0-4e96-a567-6b8d577cdd37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189eee0e84aa482e93f74740ebf9e086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:46Z,use_quota=True,user_id='9a77af447f7c4fafa0a374e7b270abdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6359b5-03a1-4bf8-90e9-48d773b58c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6359b5-03a1-4bf8-90e9-48d773b58c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f08a3e-d8c3-4406-9ee8-23d1fe6ffcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f08a3e-d8c3-4406-9ee8-23d1fe6ffcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d41314-4cb0-4e96-a567-6b8d577cdd37', 'volume_name': 'volume-03d41314-4cb0-4e96-a567-6b8d577cdd37', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df360fe7-9a67-4b57-a965-520ef8fb51d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df360fe7-9a67-4b57-a965-520ef8fb51d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b89f834-5832-4181-b9b7-e85b3e989108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Volume 03d41314-4cb0-4e96-a567-6b8d577cdd37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d41314-4cb0-4e96-a567-6b8d577cdd37', 'volume_size': 1} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1702066693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d41314-4cb0-4e96-a567-6b8d577cdd37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189eee0e84aa482e93f74740ebf9e086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:46Z,use_quota=True,user_id='9a77af447f7c4fafa0a374e7b270abdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Creating volume 03d41314-4cb0-4e96-a567-6b8d577cdd37 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:46 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:46 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 1073741824 Sep 09 14:49:46 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:46 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.370s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Deleted volume successfully. Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4834df50-7500-45b3-b5de-76007894febf tempest-VolumesActionsTest-2140818365 None] Lock "cinder-9c87dce3-a398-47c0-9f83-fde182a07f59-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:46 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 1073741824" returned: 0 in 0.600s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:46 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 Sep 09 14:49:46 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:46 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (22bb4be8-d965-4760-86b1-c76301d5dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f53370-9bbc-4744-a805-0c0dbff1a76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f53370-9bbc-4744-a805-0c0dbff1a76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233542257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c9cac-c394-4051-829d-36267129817b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:47Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d2b71c-5fdf-4007-9629-a4db7e067341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d2b71c-5fdf-4007-9629-a4db7e067341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bb3bca-3cbd-464c-a93e-0d1225b70143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bb3bca-3cbd-464c-a93e-0d1225b70143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3c9cac-c394-4051-829d-36267129817b', 'volume_name': 'volume-1d3c9cac-c394-4051-829d-36267129817b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52446936-cc53-4f82-899d-9b1806427d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52446936-cc53-4f82-899d-9b1806427d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb26dcf-4665-4e3a-9faa-9163bc05c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Volume 1d3c9cac-c394-4051-829d-36267129817b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3c9cac-c394-4051-829d-36267129817b', 'volume_size': 1} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:47 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37" returned: 0 in 0.344s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.159s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233542257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c9cac-c394-4051-829d-36267129817b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc1cc31c0484512b542c35436ba672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:47Z,use_quota=True,user_id='ccc39389c628454da02f4bc458df6405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Creating volume 1d3c9cac-c394-4051-829d-36267129817b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:47 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b89f834-5832-4181-b9b7-e85b3e989108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d41314-4cb0-4e96-a567-6b8d577cdd37', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:47 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b 1073741824 Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b75a14-9145-4866-b7b1-dd857fb1104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:47 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Volume volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 (03d41314-4cb0-4e96-a567-6b8d577cdd37): created successfully Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b75a14-9145-4866-b7b1-dd857fb1104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Flow 'volume_create_manager' (9cc82702-7f94-4917-b37e-b79f16a1a891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6dfd3117-c37f-4f23-b717-1d35fd5dd61d tempest-VolumeQuotasAdminTestJSON-542027729 None] Created volume successfully. Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b 1073741824" returned: 0 in 0.595s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:47 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:48 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b Sep 09 14:49:48 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:48 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b" returned: 0 in 0.573s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb26dcf-4665-4e3a-9faa-9163bc05c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3c9cac-c394-4051-829d-36267129817b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c052121-e133-4ad3-84b5-90ba466e6e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:48 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Volume volume-1d3c9cac-c394-4051-829d-36267129817b (1d3c9cac-c394-4051-829d-36267129817b): created successfully Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c052121-e133-4ad3-84b5-90ba466e6e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Flow 'volume_create_manager' (22bb4be8-d965-4760-86b1-c76301d5dde1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cefe96b6-26f3-4ddb-935c-6bec083b9068 tempest-VolumesActionsTest-1974533787 None] Created volume successfully. Sep 09 14:49:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d03048c-f7f4-40c8-98f5-e0c4d52cd221 tempest-VolumeQuotasAdminTestJSON-2131291717 None] Transfer volume completed successfully. Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Flow 'volume_create_manager' (514ea0eb-782f-4d02-badc-6f2ffc1f7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993e8237-4c03-47ab-b221-6507bddad909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993e8237-4c03-47ab-b221-6507bddad909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912bed51-748e-4217-a0be-28d6f7d82ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143a7f6f92e43b688e672fb0809785e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:51Z,use_quota=True,user_id='b580a0980d4a4ad4b18162015d3dfb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b697996-6c43-4e2e-b54b-264b3aed5bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b697996-6c43-4e2e-b54b-264b3aed5bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafb1828-e152-4a85-932e-62207663cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Acquiring lock "cinder-03d41314-4cb0-4e96-a567-6b8d577cdd37-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Lock "cinder-03d41314-4cb0-4e96-a567-6b8d577cdd37-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "cinder-1d3c9cac-c394-4051-829d-36267129817b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-1d3c9cac-c394-4051-829d-36267129817b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Acquiring lock "cinder-quobyte-03d41314-4cb0-4e96-a567-6b8d577cdd37" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Lock "cinder-quobyte-03d41314-4cb0-4e96-a567-6b8d577cdd37" acquired by "delete_volume" :: waited 0.056s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "cinder-quobyte-1d3c9cac-c394-4051-829d-36267129817b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-quobyte-1d3c9cac-c394-4051-829d-36267129817b" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:50 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb0341-7d3b-40b1-a07c-8d038db756d4]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ac9e7c-60ec-46db-8329-d0c754f3dd70]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafb1828-e152-4a85-932e-62207663cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '912bed51-748e-4217-a0be-28d6f7d82ac5', 'volume_name': 'volume-912bed51-748e-4217-a0be-28d6f7d82ac5', 'volume_size': 1, 'image_id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dda50cea572ea9f16a31cd5107f6587', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3143a7f6f92e43b688e672fb0809785e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e565441bc6e4662dbe20b26368abd71f6b216df8648b133c146ce0eec105397dfb25148a2421540057c2c9f3a4acf45ed44b14f712d030bfff343080949f4ec6', 'id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'created_at': datetime.datetime(2026, 9, 9, 12, 49, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 49, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe/file', 'properties': {}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:51 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 Sep 09 14:49:51 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3cdce9-1c4b-49fe-8f8f-b26219676746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3cdce9-1c4b-49fe-8f8f-b26219676746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9097f4a-10d9-4e43-a900-704e09b74753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Volume 912bed51-748e-4217-a0be-28d6f7d82ac5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-912bed51-748e-4217-a0be-28d6f7d82ac5', 'volume_size': 1, 'image_id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dda50cea572ea9f16a31cd5107f6587', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3143a7f6f92e43b688e672fb0809785e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e565441bc6e4662dbe20b26368abd71f6b216df8648b133c146ce0eec105397dfb25148a2421540057c2c9f3a4acf45ed44b14f712d030bfff343080949f4ec6', 'id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'created_at': datetime.datetime(2026, 9, 9, 12, 49, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 49, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe/file', 'properties': {}}, 'image_service': } Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Trying to clone 912bed51-748e-4217-a0be-28d6f7d82ac5 from image bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:49:51 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b Sep 09 14:49:51 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:49:51 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Image download 0.00 MB at 0.00 MB/s Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d860b74-76f4-4d09-a86a-b3d50874ab51]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:51 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37" returned: 0 in 0.548s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:51 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37 Sep 09 14:49:51 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:51 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD Sep 09 14:49:51 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:51 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b" returned: 0 in 0.603s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:51 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b Sep 09 14:49:51 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:51 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-03d41314-4cb0-4e96-a567-6b8d577cdd37" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Lock "cinder-quobyte-03d41314-4cb0-4e96-a567-6b8d577cdd37" released by "delete_volume" :: held 0.991s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:51 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Created reservations ['92a30a2b-0e8b-49cd-a004-7ff4b9d6709f', '4c55b6ac-9f77-4320-ac85-f21c406e5a77', '2716f27c-fa5f-4c68-8940-ef19ed8a4c43', '92586e0d-48a6-46eb-9b7f-fc150dfe6647'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:52 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3c9cac-c394-4051-829d-36267129817b" returned: 0 in 0.442s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:52 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD Sep 09 14:49:52 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-quobyte-1d3c9cac-c394-4051-829d-36267129817b" released by "delete_volume" :: held 1.131s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Created reservations ['7cfd94c8-dba7-47eb-ae54-e4b25ccf06db', '30998ed0-79b7-4bc4-89b5-feb48809870f', '7065d6ba-240b-42d0-8757-c41a78b5fb39', '6631f6b3-8958-4d41-8186-3258e267206e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:49:52 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:52 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:52 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:52 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:52 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD" returned: 1 in 0.496s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Temporary image bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe is fetched for user b580a0980d4a4ad4b18162015d3dfb9c. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:49:52 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:49:52 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe5af00-30a2-4508-b49f-1e3e8a016ed3]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:52 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:52 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Deleted volume successfully. Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-75ffbe50-82fa-4880-a75c-62f9d048c100 tempest-VolumeQuotasAdminTestJSON-1841926844 None] Lock "cinder-03d41314-4cb0-4e96-a567-6b8d577cdd37-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:52 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD Sep 09 14:49:52 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:52 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.505s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:52 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 28 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.431s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:49:52 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Deleted volume successfully. Sep 09 14:49:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-58dbb725-0135-4bc4-8426-4c8cea9f1a78 tempest-VolumesActionsTest-1974533787 None] Lock "cinder-1d3c9cac-c394-4051-829d-36267129817b-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:49:53 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:53 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD Sep 09 14:49:53 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:53 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912bed51-748e-4217-a0be-28d6f7d82ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143a7f6f92e43b688e672fb0809785e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:49:51Z,use_quota=True,user_id='b580a0980d4a4ad4b18162015d3dfb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Creating volume 912bed51-748e-4217-a0be-28d6f7d82ac5 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:49:53 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:49:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:53 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 1073741824 Sep 09 14:49:53 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:54 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 1073741824" returned: 0 in 0.743s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:54 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 Sep 09 14:49:54 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:54 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Attempting download of bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe ((None, [{'url': 'file:///opt/stack/data/glance/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'metadata': {}}])) to volume 912bed51-748e-4217-a0be-28d6f7d82ac5. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0cc3ef-df15-43b8-9907-538776c438a9]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:55 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e Sep 09 14:49:55 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:55 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e" returned: 0 in 0.604s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:55 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e Sep 09 14:49:55 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:55 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e" returned: 1 in 0.411s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_lxitgz3e' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:49:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45e2005-a586-438d-bc5c-5b9500e53e38]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:56 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD Sep 09 14:49:56 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:56 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:56 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD Sep 09 14:49:56 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:56 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:49:56 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe was raw, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:49:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:56 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 Sep 09 14:49:56 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:57 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5" returned: 0 in 0.627s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:57 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe_7k_o4tkgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:49:57 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 14:49:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:57 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 1G Sep 09 14:49:57 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:49:58 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 1G" returned: 0 in 0.541s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Downloaded image bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe ((None, [{'url': 'file:///opt/stack/data/glance/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'metadata': {}}])) to volume 912bed51-748e-4217-a0be-28d6f7d82ac5 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Temporary image bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe for user b580a0980d4a4ad4b18162015d3dfb9c is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Marking volume 912bed51-748e-4217-a0be-28d6f7d82ac5 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Copying metadata from image bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe to 912bed51-748e-4217-a0be-28d6f7d82ac5. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Creating volume glance metadata for volume 912bed51-748e-4217-a0be-28d6f7d82ac5 backed by image bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe with: {'image_id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4dda50cea572ea9f16a31cd5107f6587', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9097f4a-10d9-4e43-a900-704e09b74753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912bed51-748e-4217-a0be-28d6f7d82ac5', 'volume_size': 1, 'image_id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dda50cea572ea9f16a31cd5107f6587', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3143a7f6f92e43b688e672fb0809785e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e565441bc6e4662dbe20b26368abd71f6b216df8648b133c146ce0eec105397dfb25148a2421540057c2c9f3a4acf45ed44b14f712d030bfff343080949f4ec6', 'id': 'bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe', 'created_at': datetime.datetime(2026, 9, 9, 12, 49, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 49, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc2ec2f1-08ac-4346-94da-8b1e2df4fdbe/file', 'properties': {}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c732ddab-12ce-4ba9-bc94-572325c161d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:49:58 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Volume volume-912bed51-748e-4217-a0be-28d6f7d82ac5 (912bed51-748e-4217-a0be-28d6f7d82ac5): created successfully Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c732ddab-12ce-4ba9-bc94-572325c161d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:49:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Flow 'volume_create_manager' (514ea0eb-782f-4d02-badc-6f2ffc1f7880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:49:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e95a1fe2-044e-4a6f-b065-ed0bd23c3a35 tempest-VolumeImageDependencyTests-2027668670 None] Created volume successfully. Sep 09 14:49:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Acquiring lock "cinder-912bed51-748e-4217-a0be-28d6f7d82ac5-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Lock "cinder-912bed51-748e-4217-a0be-28d6f7d82ac5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Acquiring lock "cinder-quobyte-912bed51-748e-4217-a0be-28d6f7d82ac5" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:49:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Lock "cinder-quobyte-912bed51-748e-4217-a0be-28d6f7d82ac5" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:49:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc56a1-ff01-4e9c-95f0-45ae8c4ce21e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:49:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:49:59 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 Sep 09 14:49:59 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:00 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5" returned: 0 in 0.534s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:00 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5 Sep 09 14:50:00 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:00 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-912bed51-748e-4217-a0be-28d6f7d82ac5" returned: 0 in 0.323s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Lock "cinder-quobyte-912bed51-748e-4217-a0be-28d6f7d82ac5" released by "delete_volume" :: held 0.918s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Created reservations ['28602feb-01f3-49aa-9431-af542ddeef34', '20872128-9753-4494-8eae-ab9b4cc6cb50', 'db7c503e-1a6b-4c48-bb28-d2c6a5e038af', 'b81472f0-ce80-4940-8667-35155efaf935'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:00 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:00 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:01 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.365s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:01 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Deleted volume successfully. Sep 09 14:50:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-71780b9a-bc00-41d9-80a5-4a5e251cc71f tempest-VolumeImageDependencyTests-2027668670 None] Lock "cinder-912bed51-748e-4217-a0be-28d6f7d82ac5-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Flow 'volume_create_manager' (6cbfe699-e220-43ce-9918-f2c5a382bcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf64fd1-1a19-426d-ab63-f256bf735af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf64fd1-1a19-426d-ab63-f256bf735af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-691149427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174cb16b-be82-4f06-bf2d-9ea4d50f09ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c10366c1274190abcd3b18f7536dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:04Z,use_quota=True,user_id='97c89eab58084b6f8b00b2baf07871b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e36e93a4-7403-46d6-bd87-f7ce6b9edc5e),volume_type_id=e36e93a4-7403-46d6-bd87-f7ce6b9edc5e)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5412cf-eead-4e47-90cd-1c90359cbcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5412cf-eead-4e47-90cd-1c90359cbcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c639f99-ca27-4954-b8b4-02936f968529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c639f99-ca27-4954-b8b4-02936f968529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174cb16b-be82-4f06-bf2d-9ea4d50f09ee', 'volume_name': 'volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d713d71c-508d-4c24-8ba6-ad1203c04153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d713d71c-508d-4c24-8ba6-ad1203c04153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9cf9f8-348e-490e-ba58-0aa726437d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:04 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Volume 174cb16b-be82-4f06-bf2d-9ea4d50f09ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee', 'volume_size': 1} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-691149427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174cb16b-be82-4f06-bf2d-9ea4d50f09ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c10366c1274190abcd3b18f7536dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:04Z,use_quota=True,user_id='97c89eab58084b6f8b00b2baf07871b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e36e93a4-7403-46d6-bd87-f7ce6b9edc5e),volume_type_id=e36e93a4-7403-46d6-bd87-f7ce6b9edc5e)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Creating volume 174cb16b-be82-4f06-bf2d-9ea4d50f09ee {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:04 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:04 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee 1073741824 Sep 09 14:50:04 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:05 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee 1073741824" returned: 0 in 0.707s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:05 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee Sep 09 14:50:05 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:05 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee" returned: 0 in 0.324s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9cf9f8-348e-490e-ba58-0aa726437d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ecbfac-094f-4f9a-ab47-b17716d61e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:05 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Volume volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee (174cb16b-be82-4f06-bf2d-9ea4d50f09ee): created successfully Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ecbfac-094f-4f9a-ab47-b17716d61e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Flow 'volume_create_manager' (6cbfe699-e220-43ce-9918-f2c5a382bcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8bd39de1-e66d-48f7-891f-319cfd6356ec tempest-VolumeTypesAccessTest-933762945 None] Created volume successfully. Sep 09 14:50:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Acquiring lock "cinder-174cb16b-be82-4f06-bf2d-9ea4d50f09ee-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Lock "cinder-174cb16b-be82-4f06-bf2d-9ea4d50f09ee-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Acquiring lock "cinder-quobyte-174cb16b-be82-4f06-bf2d-9ea4d50f09ee" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Lock "cinder-quobyte-174cb16b-be82-4f06-bf2d-9ea4d50f09ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:06 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c639f7-61c0-4e54-931d-35ee48027be8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:06 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee Sep 09 14:50:06 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:07 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee" returned: 0 in 0.421s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:07 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee Sep 09 14:50:07 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:07 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-174cb16b-be82-4f06-bf2d-9ea4d50f09ee" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Lock "cinder-quobyte-174cb16b-be82-4f06-bf2d-9ea4d50f09ee" released by "delete_volume" :: held 0.750s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:07 devstack cinder-volume[87325]: WARNING cinder.quota [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1461168980 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1461168980, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:50:07 devstack cinder-volume[87325]: WARNING cinder.quota [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1461168980 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1461168980, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Created reservations ['9cf460d8-883e-479c-a460-3231f4d44fe7', 'a9f45cd2-a83a-4df4-8329-6f01b6067871', '98c016f2-60eb-42d9-8cc9-975c47902d91', 'a4ec34c6-9e0e-4797-a102-7bf7603f2eb3'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:07 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:07 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:07 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.294s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:07 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Deleted volume successfully. Sep 09 14:50:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b3324abf-40a6-4382-939e-69057fd73b8e tempest-VolumeTypesAccessTest-933762945 None] Lock "cinder-174cb16b-be82-4f06-bf2d-9ea4d50f09ee-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (9e3eacc9-08d5-4fce-b28b-d237cfda382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb83da79-d40a-4c40-b87d-33e48ae789d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb83da79-d40a-4c40-b87d-33e48ae789d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112274625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aba749e-efad-4294-8f2f-8f57567402f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:08Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967452fd-f39a-4f16-9800-009d20fde94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967452fd-f39a-4f16-9800-009d20fde94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c190f35-e0b7-4c03-8bab-7112794bb3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c190f35-e0b7-4c03-8bab-7112794bb3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aba749e-efad-4294-8f2f-8f57567402f6', 'volume_name': 'volume-8aba749e-efad-4294-8f2f-8f57567402f6', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b6c141-00cc-4fa1-9677-726309eae632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b6c141-00cc-4fa1-9677-726309eae632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa5bfca-c678-4679-bbfb-eb98034416fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:08 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Volume 8aba749e-efad-4294-8f2f-8f57567402f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aba749e-efad-4294-8f2f-8f57567402f6', 'volume_size': 1} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112274625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aba749e-efad-4294-8f2f-8f57567402f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:08Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Creating volume 8aba749e-efad-4294-8f2f-8f57567402f6 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:08 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:08 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 1073741824 Sep 09 14:50:08 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:08 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 1073741824" returned: 0 in 0.501s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:09 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 Sep 09 14:50:09 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:09 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6" returned: 0 in 0.300s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa5bfca-c678-4679-bbfb-eb98034416fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aba749e-efad-4294-8f2f-8f57567402f6', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22a966a-4ee2-4003-957c-c034013bb17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:09 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Volume volume-8aba749e-efad-4294-8f2f-8f57567402f6 (8aba749e-efad-4294-8f2f-8f57567402f6): created successfully Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22a966a-4ee2-4003-957c-c034013bb17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (9e3eacc9-08d5-4fce-b28b-d237cfda382f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:09 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-67d7e591-df86-4002-ac0f-0834983a533d tempest-ProjectReaderTests-318840241 None] Created volume successfully. Sep 09 14:50:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-8aba749e-efad-4294-8f2f-8f57567402f6-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Lock "cinder-8aba749e-efad-4294-8f2f-8f57567402f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-quobyte-8aba749e-efad-4294-8f2f-8f57567402f6" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-8aba749e-efad-4294-8f2f-8f57567402f6" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2809a-1580-42cf-816e-f47246446e5c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:11 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 Sep 09 14:50:11 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:11 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6" returned: 0 in 0.396s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:11 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6 Sep 09 14:50:11 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:11 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8aba749e-efad-4294-8f2f-8f57567402f6" returned: 0 in 0.328s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-8aba749e-efad-4294-8f2f-8f57567402f6" released by "delete_volume" :: held 0.782s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Created reservations ['42bf6c13-ce64-49b7-a6ee-d13ed880305c', 'af777399-033d-4166-a429-303fb47fed80', '6fa01dec-8882-466a-88cb-9bc501eddb3f', '9e7faf1e-a5e1-4b20-bd46-2440ab271910'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:12 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:12 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:12 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.368s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Deleted volume successfully. Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-700c60e1-2a6c-41c6-ba54-5eb3bb6dbe77 tempest-ProjectReaderTests-318840241 None] Lock "cinder-8aba749e-efad-4294-8f2f-8f57567402f6-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (dcb7720f-4941-461e-961c-8d9e84f6f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29ae6f8-0903-4d78-9c04-5ea143ce008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29ae6f8-0903-4d78-9c04-5ea143ce008e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904610346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64651fa6-fcad-4680-a80f-0b07d8f06772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:13Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f377d8-1502-4b04-84cb-2f6bd37946c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f377d8-1502-4b04-84cb-2f6bd37946c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29c7ef6-f6b6-48a2-a02a-1600a7485b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29c7ef6-f6b6-48a2-a02a-1600a7485b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64651fa6-fcad-4680-a80f-0b07d8f06772', 'volume_name': 'volume-64651fa6-fcad-4680-a80f-0b07d8f06772', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a2aabb-1758-46a1-9084-f615fba59e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a2aabb-1758-46a1-9084-f615fba59e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364ed8b-5fd2-4b52-8fae-23ddef96b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:12 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Volume 64651fa6-fcad-4680-a80f-0b07d8f06772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64651fa6-fcad-4680-a80f-0b07d8f06772', 'volume_size': 1} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904610346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64651fa6-fcad-4680-a80f-0b07d8f06772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:13Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Creating volume 64651fa6-fcad-4680-a80f-0b07d8f06772 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:12 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:13 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 1073741824 Sep 09 14:50:13 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:13 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 1073741824" returned: 0 in 0.486s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:13 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 Sep 09 14:50:13 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:13 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772" returned: 0 in 0.328s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364ed8b-5fd2-4b52-8fae-23ddef96b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64651fa6-fcad-4680-a80f-0b07d8f06772', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e0b890-e5ef-47c3-a863-5ec1a6aecbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:13 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Volume volume-64651fa6-fcad-4680-a80f-0b07d8f06772 (64651fa6-fcad-4680-a80f-0b07d8f06772): created successfully Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e0b890-e5ef-47c3-a863-5ec1a6aecbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (dcb7720f-4941-461e-961c-8d9e84f6f2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ace1bd3a-76f1-4ed9-a972-ab9ee4f593b4 tempest-ProjectReaderTests-318840241 None] Created volume successfully. Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-64651fa6-fcad-4680-a80f-0b07d8f06772-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Lock "cinder-64651fa6-fcad-4680-a80f-0b07d8f06772-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-quobyte-64651fa6-fcad-4680-a80f-0b07d8f06772" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-64651fa6-fcad-4680-a80f-0b07d8f06772" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3462c164-77aa-472a-9c3c-28bc6f5ebf97]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:15 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 Sep 09 14:50:15 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:15 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772" returned: 0 in 0.401s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:15 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772 Sep 09 14:50:15 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:15 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-64651fa6-fcad-4680-a80f-0b07d8f06772" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-64651fa6-fcad-4680-a80f-0b07d8f06772" released by "delete_volume" :: held 0.754s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=166,cinder:UPDATE=228,cinder:INSERT=58,cinder:DELETE=20 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=168,cinder:UPDATE=219,cinder:DELETE=18,cinder:INSERT=55 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:50:15 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Created reservations ['e436f4b4-962f-437c-8875-3492ebbf62e8', '13381e11-7bb5-43f0-9fc3-a17517cc50fe', '229463a5-9beb-490d-aa54-788ef914499a', 'c89b6e35-2334-41e8-834c-c6190d197737'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Flow 'volume_create_manager' (c7bb6bbd-ce24-4ca3-8de7-d847da50cc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbb78f1-fa1f-4d19-91ef-a4351a67bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbb78f1-fa1f-4d19-91ef-a4351a67bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1627128102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec967a66-dd43-42d5-8ac5-eba135a16113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782448ad52124648b698191544fe5feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:16Z,use_quota=True,user_id='bd8a35c60e1540539921382e8c617a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42472697-4162-43ca-a1e0-7c6a5f95b7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42472697-4162-43ca-a1e0-7c6a5f95b7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511267e7-5a79-4ef2-9529-9d94a8132b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:16 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:16 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:16 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Deleted volume successfully. Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-bfd7e19e-4417-4eed-9559-7adf52eda808 tempest-ProjectReaderTests-318840241 None] Lock "cinder-64651fa6-fcad-4680-a80f-0b07d8f06772-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511267e7-5a79-4ef2-9529-9d94a8132b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec967a66-dd43-42d5-8ac5-eba135a16113', 'volume_name': 'volume-ec967a66-dd43-42d5-8ac5-eba135a16113', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04681345-081b-47cd-8152-da054061271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04681345-081b-47cd-8152-da054061271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ceaa9a-434e-40d2-a69d-3fc4c077e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:16 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Volume ec967a66-dd43-42d5-8ac5-eba135a16113: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec967a66-dd43-42d5-8ac5-eba135a16113', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 14:50:16 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Trying to clone ec967a66-dd43-42d5-8ac5-eba135a16113 from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:50:17 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Image download 20.69 MB at 20.69 MB/s Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Flow 'volume_create_manager' (c31d4f37-df89-4a1f-8cb9-9ce76426bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05afc5e0-b8e2-4766-9dcf-9155b8cb9e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (538dff9d-a7f3-4b7c-be14-8467c639e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e1dd05-c57f-4aa7-b361-064d9ebaac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05afc5e0-b8e2-4766-9dcf-9155b8cb9e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-395571023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a40b29-6601-4218-b0cf-b615ea33bf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473421dc98404be3987b67980e5d311a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:17Z,use_quota=True,user_id='9033c9fb3c1a425099e9eab339ea2076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c093197a-17d2-4597-8cb4-f53d1514326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c093197a-17d2-4597-8cb4-f53d1514326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ebdfc0-16a0-4c26-8b6a-6437418a9973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ebdfc0-16a0-4c26-8b6a-6437418a9973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a40b29-6601-4218-b0cf-b615ea33bf20', 'volume_name': 'volume-f5a40b29-6601-4218-b0cf-b615ea33bf20', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b39595-cd21-4919-9642-dfe3b5cf6dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b39595-cd21-4919-9642-dfe3b5cf6dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30518d6-56b6-425e-89a4-b64916dd2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Volume f5a40b29-6601-4218-b0cf-b615ea33bf20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a40b29-6601-4218-b0cf-b615ea33bf20', 'volume_size': 1} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-395571023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a40b29-6601-4218-b0cf-b615ea33bf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473421dc98404be3987b67980e5d311a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:17Z,use_quota=True,user_id='9033c9fb3c1a425099e9eab339ea2076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Creating volume f5a40b29-6601-4218-b0cf-b615ea33bf20 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:17 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e1dd05-c57f-4aa7-b361-064d9ebaac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562051319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebddf8-faf9-4d2a-851a-330d070a0023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:17Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 1073741824 Sep 09 14:50:17 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2955b96-67ed-469f-8901-0e7d88e7a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2955b96-67ed-469f-8901-0e7d88e7a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d242ef06-02c3-43d0-9d7e-01248b4d241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d242ef06-02c3-43d0-9d7e-01248b4d241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cebddf8-faf9-4d2a-851a-330d070a0023', 'volume_name': 'volume-3cebddf8-faf9-4d2a-851a-330d070a0023', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71ccd71-4377-4e28-af99-a8f5290c5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71ccd71-4377-4e28-af99-a8f5290c5560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93094e06-4784-4dfe-910f-093408d324c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Volume 3cebddf8-faf9-4d2a-851a-330d070a0023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cebddf8-faf9-4d2a-851a-330d070a0023', 'volume_size': 1} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e843c-b6d4-454a-8aa1-e73954660ee0]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:17 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD Sep 09 14:50:17 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:17 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:17 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 1073741824" returned: 0 in 0.418s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 is fetched for user bd8a35c60e1540539921382e8c617a3f. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:17 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 Sep 09 14:50:17 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ae9393-1780-41bf-bfaf-62260f2ed519]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:17 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD Sep 09 14:50:17 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:17 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20" returned: 0 in 0.269s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562051319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebddf8-faf9-4d2a-851a-330d070a0023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:17Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Creating volume 3cebddf8-faf9-4d2a-851a-330d070a0023 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:17 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30518d6-56b6-425e-89a4-b64916dd2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a40b29-6601-4218-b0cf-b615ea33bf20', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b8e2e2-0cc3-4352-b6b6-ed3b33ec60c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:17 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 1073741824 Sep 09 14:50:17 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:17 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Volume volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 (f5a40b29-6601-4218-b0cf-b615ea33bf20): created successfully Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b8e2e2-0cc3-4352-b6b6-ed3b33ec60c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Flow 'volume_create_manager' (c31d4f37-df89-4a1f-8cb9-9ce76426bc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a3a3e7b8-63c9-470e-bc9f-81a310426800 tempest-AbsoluteLimitsTests-921818908 None] Created volume successfully. Sep 09 14:50:18 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:18 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 1073741824" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:18 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 Sep 09 14:50:18 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:18 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023" returned: 0 in 0.259s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1627128102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec967a66-dd43-42d5-8ac5-eba135a16113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782448ad52124648b698191544fe5feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:16Z,use_quota=True,user_id='bd8a35c60e1540539921382e8c617a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Creating volume ec967a66-dd43-42d5-8ac5-eba135a16113 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:18 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:18 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 1073741824 Sep 09 14:50:18 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93094e06-4784-4dfe-910f-093408d324c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cebddf8-faf9-4d2a-851a-330d070a0023', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13800363-8c69-48fb-ab42-63b67ac4f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Volume volume-3cebddf8-faf9-4d2a-851a-330d070a0023 (3cebddf8-faf9-4d2a-851a-330d070a0023): created successfully Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13800363-8c69-48fb-ab42-63b67ac4f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (538dff9d-a7f3-4b7c-be14-8467c639e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c0e3a578-04d8-4f63-873c-4396bb5a4d4d tempest-ProjectReaderTests-318840241 None] Created volume successfully. Sep 09 14:50:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-3cebddf8-faf9-4d2a-851a-330d070a0023-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Lock "cinder-3cebddf8-faf9-4d2a-851a-330d070a0023-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Acquiring lock "cinder-f5a40b29-6601-4218-b0cf-b615ea33bf20-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-quobyte-3cebddf8-faf9-4d2a-851a-330d070a0023" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Lock "cinder-f5a40b29-6601-4218-b0cf-b615ea33bf20-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-3cebddf8-faf9-4d2a-851a-330d070a0023" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Acquiring lock "cinder-quobyte-f5a40b29-6601-4218-b0cf-b615ea33bf20" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9ad861-84fd-40dc-991f-110c7e2adbbe]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Lock "cinder-quobyte-f5a40b29-6601-4218-b0cf-b615ea33bf20" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23708e-8b1f-4209-9de9-617c7ce61d86]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:19 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 1073741824" returned: 0 in 0.566s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 Sep 09 14:50:19 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:19 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 Sep 09 14:50:19 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:19 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 Sep 09 14:50:19 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:19 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023" returned: 0 in 0.392s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:19 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:19 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:19 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023 Sep 09 14:50:19 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20" returned: 0 in 0.376s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:19 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20 Sep 09 14:50:19 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Attempting download of 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume ec967a66-dd43-42d5-8ac5-eba135a16113. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc954ee4-2a35-4149-a12b-908c5acd8491]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_ {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:19 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_ Sep 09 14:50:19 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:19 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3cebddf8-faf9-4d2a-851a-330d070a0023" returned: 0 in 0.280s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-3cebddf8-faf9-4d2a-851a-330d070a0023" released by "delete_volume" :: held 0.734s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:19 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-f5a40b29-6601-4218-b0cf-b615ea33bf20" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Lock "cinder-quobyte-f5a40b29-6601-4218-b0cf-b615ea33bf20" released by "delete_volume" :: held 0.714s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Created reservations ['fba045ef-0890-40b8-9d43-b1e3a879f724', 'e9800863-4c0e-4521-9c4c-25ff8d7788e1', 'b45f037e-7719-4659-95ab-e209f2a85219', '32ea2e0d-550f-4aec-b87e-812f006773e4'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Created reservations ['f5dba023-9f13-4354-96f8-9dc1a1c3fd63', 'b8515564-5046-4a45-900f-590df03f9afa', 'c1c31ec5-7312-46d9-9a65-d8793c9940b8', '4ab40a0b-221a-427c-85cc-faeab30226c0'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:19 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_" returned: 0 in 0.344s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_ {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:20 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:20 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:20 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_ Sep 09 14:50:20 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:20 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:20 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:20 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_" returned: 1 in 0.381s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dcaa084-c738-4c9b-8211-0cc749ab59f6_54gej9h_' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[107d6aeb-936b-4017-886a-8fe896ceb3b8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:20 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:20 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.408s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.468s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Deleted volume successfully. Sep 09 14:50:20 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD Sep 09 14:50:20 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-49df6a48-cb02-47b2-bd74-bbe6834960f7 tempest-AbsoluteLimitsTests-921818908 None] Lock "cinder-f5a40b29-6601-4218-b0cf-b615ea33bf20-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Deleted volume successfully. Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6fb38a52-d05f-4315-847d-9e42c5e88168 tempest-ProjectReaderTests-318840241 None] Lock "cinder-3cebddf8-faf9-4d2a-851a-330d070a0023-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:20 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] 0dcaa084-c738-4c9b-8211-0cc749ab59f6 was qcow2, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:20 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 Sep 09 14:50:20 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (2254ffce-e89e-41b3-9155-09b6512ccd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4aba26-e053-4662-b366-09339ce6d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4aba26-e053-4662-b366-09339ce6d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047594284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f5470-453b-4a4b-9a14-76d8f553dcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:21Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68353107-8b82-4769-9fc2-d6e59aae137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68353107-8b82-4769-9fc2-d6e59aae137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd06a96-031a-4756-b192-ccbfbee68ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd06a96-031a-4756-b192-ccbfbee68ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337f5470-453b-4a4b-9a14-76d8f553dcb5', 'volume_name': 'volume-337f5470-453b-4a4b-9a14-76d8f553dcb5', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cd21ea-eb13-4005-bbb7-ce5f47e045d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cd21ea-eb13-4005-bbb7-ce5f47e045d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf41e17-8260-40ba-ab5a-cc2db78877e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Volume 337f5470-453b-4a4b-9a14-76d8f553dcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337f5470-453b-4a4b-9a14-76d8f553dcb5', 'volume_size': 1} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047594284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337f5470-453b-4a4b-9a14-76d8f553dcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cf882c6e624529b8d430b88828a5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:21Z,use_quota=True,user_id='40da2656b184406a8f2a6f7fe793a65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Creating volume 337f5470-453b-4a4b-9a14-76d8f553dcb5 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:21 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:21 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 1073741824 Sep 09 14:50:21 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:21 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 1073741824" returned: 0 in 0.492s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:21 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 Sep 09 14:50:21 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:21 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5" returned: 0 in 0.317s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf41e17-8260-40ba-ab5a-cc2db78877e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337f5470-453b-4a4b-9a14-76d8f553dcb5', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d3fb6-a2ee-45c1-aab9-8e75d10913a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Volume volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 (337f5470-453b-4a4b-9a14-76d8f553dcb5): created successfully Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d3fb6-a2ee-45c1-aab9-8e75d10913a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Flow 'volume_create_manager' (2254ffce-e89e-41b3-9155-09b6512ccd05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:21 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d20b7ae6-e11f-403a-afab-47f0de2f72ae tempest-ProjectReaderTests-318840241 None] Created volume successfully. Sep 09 14:50:22 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113" returned: 0 in 1.964s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:22 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0dcaa084-c738-4c9b-8211-0cc749ab59f6_79dl4xaudevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:50:22 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Converted 112.00 MB image at 56.98 MB/s Sep 09 14:50:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:22 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 1G Sep 09 14:50:22 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-337f5470-453b-4a4b-9a14-76d8f553dcb5-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Lock "cinder-337f5470-453b-4a4b-9a14-76d8f553dcb5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Acquiring lock "cinder-quobyte-337f5470-453b-4a4b-9a14-76d8f553dcb5" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-337f5470-453b-4a4b-9a14-76d8f553dcb5" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:23 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 1G" returned: 0 in 0.379s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Downloaded image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}])) to volume ec967a66-dd43-42d5-8ac5-eba135a16113 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Temporary image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 for user bd8a35c60e1540539921382e8c617a3f is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Marking volume ec967a66-dd43-42d5-8ac5-eba135a16113 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b00913-927a-4dcf-b407-8417b128c97d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Copying metadata from image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 to ec967a66-dd43-42d5-8ac5-eba135a16113. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Creating volume glance metadata for volume ec967a66-dd43-42d5-8ac5-eba135a16113 backed by image 0dcaa084-c738-4c9b-8211-0cc749ab59f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ceaa9a-434e-40d2-a69d-3fc4c077e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec967a66-dd43-42d5-8ac5-eba135a16113', 'volume_size': 1, 'image_id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49c562cb87824a54ac11d607c2b3f092', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dcaa084-c738-4c9b-8211-0cc749ab59f6', 'created_at': datetime.datetime(2026, 9, 9, 12, 32, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 32, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dcaa084-c738-4c9b-8211-0cc749ab59f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc4c754-40ad-4575-8d74-233ef021b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Volume volume-ec967a66-dd43-42d5-8ac5-eba135a16113 (ec967a66-dd43-42d5-8ac5-eba135a16113): created successfully Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc4c754-40ad-4575-8d74-233ef021b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Flow 'volume_create_manager' (c7bb6bbd-ce24-4ca3-8de7-d847da50cc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:23 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 Sep 09 14:50:23 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1cc5158b-84b6-4505-9db2-fcc951940fdb tempest-VolumesImageMetadata-776126468 None] Created volume successfully. Sep 09 14:50:23 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:23 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5 Sep 09 14:50:23 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:23 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-337f5470-453b-4a4b-9a14-76d8f553dcb5" returned: 0 in 0.264s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Lock "cinder-quobyte-337f5470-453b-4a4b-9a14-76d8f553dcb5" released by "delete_volume" :: held 0.740s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:23 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Created reservations ['61c39bc1-6be6-4c32-b781-44c23df4aac4', 'a1983823-943a-4f81-a40d-ff650790b779', '15608bdb-5046-40c5-8094-17306b94c046', 'a868c5cb-beff-4b0a-86e5-50835d94aaf3'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:24 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:24 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:24 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Acquiring lock "cinder-ec967a66-dd43-42d5-8ac5-eba135a16113-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.301s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Deleted volume successfully. Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Lock "cinder-ec967a66-dd43-42d5-8ac5-eba135a16113-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3ba136b7-9502-43a4-8c16-ce9d7d18cd00 tempest-ProjectReaderTests-318840241 None] Lock "cinder-337f5470-453b-4a4b-9a14-76d8f553dcb5-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Acquiring lock "cinder-quobyte-ec967a66-dd43-42d5-8ac5-eba135a16113" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Lock "cinder-quobyte-ec967a66-dd43-42d5-8ac5-eba135a16113" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[60358844-3514-44b3-9307-442d27fccb5e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:24 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 Sep 09 14:50:24 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:24 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113" returned: 0 in 0.389s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:24 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113 Sep 09 14:50:24 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:25 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-ec967a66-dd43-42d5-8ac5-eba135a16113" returned: 0 in 0.293s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Lock "cinder-quobyte-ec967a66-dd43-42d5-8ac5-eba135a16113" released by "delete_volume" :: held 0.741s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Created reservations ['4d4f27b7-e761-49fb-944f-28096229e5fe', 'fb316cb3-0bd5-4ed2-8d00-0771b3bda6b1', '0fa440be-937d-44e6-aef2-2f0708f3104b', '391fc7f4-a100-4cc8-a424-51dbacb3903e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:25 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:25 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:25 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Deleted volume successfully. Sep 09 14:50:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-656dc234-f3fd-492e-9114-8f13ae3a9de7 tempest-VolumesImageMetadata-776126468 None] Lock "cinder-ec967a66-dd43-42d5-8ac5-eba135a16113-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Flow 'volume_create_manager' (845fb4be-6245-40bb-8bf9-7551f43184d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fa38e3-708f-4fdc-8b9a-2952322007a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fa38e3-708f-4fdc-8b9a-2952322007a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-139766087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25612d6a-5ba8-48d2-89f2-b3fb45244f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9342077e6554026946eef027cea51cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:29Z,use_quota=True,user_id='a6b9851f5c4141de8c8b6884061bd23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bfc633-342c-4c7d-a70c-08ae75e76332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bfc633-342c-4c7d-a70c-08ae75e76332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189b32a0-f47a-4364-bf91-facfc11ec737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189b32a0-f47a-4364-bf91-facfc11ec737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25612d6a-5ba8-48d2-89f2-b3fb45244f7e', 'volume_name': 'volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65219152-a7ca-4997-bb0b-588bbbbc6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65219152-a7ca-4997-bb0b-588bbbbc6e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa094bc-e460-4089-a2b0-69e16a7fd75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:28 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Volume 25612d6a-5ba8-48d2-89f2-b3fb45244f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e', 'volume_size': 1} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-139766087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25612d6a-5ba8-48d2-89f2-b3fb45244f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9342077e6554026946eef027cea51cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:29Z,use_quota=True,user_id='a6b9851f5c4141de8c8b6884061bd23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Creating volume 25612d6a-5ba8-48d2-89f2-b3fb45244f7e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:28 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:28 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e 1073741824 Sep 09 14:50:28 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:29 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e 1073741824" returned: 0 in 0.922s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:29 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e Sep 09 14:50:29 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:30 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e" returned: 0 in 0.328s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa094bc-e460-4089-a2b0-69e16a7fd75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa052e9-50fe-485f-8d03-e27ca92080cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:30 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Volume volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e (25612d6a-5ba8-48d2-89f2-b3fb45244f7e): created successfully Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa052e9-50fe-485f-8d03-e27ca92080cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:30 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Flow 'volume_create_manager' (845fb4be-6245-40bb-8bf9-7551f43184d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5f3c82a3-71f9-4697-8af8-712f20f60c75 tempest-VolumesTransfersV355Test-848611607 None] Created volume successfully. Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Flow 'volume_create_manager' (f9049962-460b-4396-ab19-44f31a20b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45be90c-645b-47c9-8e54-0514a1f55064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45be90c-645b-47c9-8e54-0514a1f55064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-803133785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc5cde0-1a69-4a3c-95ad-379e39d387d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df9583bdf0d49deaf889b4fe5768165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:31Z,use_quota=True,user_id='d3748230fe494da8a801303eab4046e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a9ca53-17d7-4e2f-9d67-b59abfafc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a9ca53-17d7-4e2f-9d67-b59abfafc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d77ac01-945e-462d-adb2-de51885d1cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d77ac01-945e-462d-adb2-de51885d1cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc5cde0-1a69-4a3c-95ad-379e39d387d0', 'volume_name': 'volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153eb4ec-f099-433a-985c-1672fce201ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153eb4ec-f099-433a-985c-1672fce201ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99af120a-ef54-45c7-9b81-7772f62636d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:31 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Volume cfc5cde0-1a69-4a3c-95ad-379e39d387d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0', 'volume_size': 1} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-803133785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc5cde0-1a69-4a3c-95ad-379e39d387d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df9583bdf0d49deaf889b4fe5768165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:31Z,use_quota=True,user_id='d3748230fe494da8a801303eab4046e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Creating volume cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:31 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-5a115ba1-9b77-4920-978e-2d6f2a3b4ce2 tempest-TestShelveInstance-1499452957 None] Terminate volume connection completed successfully. Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-5a115ba1-9b77-4920-978e-2d6f2a3b4ce2 tempest-TestShelveInstance-1499452957 None] Deleting attachment d3951467-7435-4509-97bd-76325d0464e5. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:50:31 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 1073741824 Sep 09 14:50:31 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Acquiring lock "cinder-82755c24-e3e0-4696-95c7-963fdea77278-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Lock "cinder-82755c24-e3e0-4696-95c7-963fdea77278-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Acquiring lock "cinder-quobyte-82755c24-e3e0-4696-95c7-963fdea77278" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Lock "cinder-quobyte-82755c24-e3e0-4696-95c7-963fdea77278" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e8f97-26b9-4d3c-8dd4-de768a251eac]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5528d373-2b8b-4bba-be11-baaa72fbbb41 tempest-VolumesTransfersV355Test-1513071780 None] Transfer volume completed successfully. Sep 09 14:50:32 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 Sep 09 14:50:32 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:32 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 1073741824" returned: 0 in 0.759s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:32 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 Sep 09 14:50:32 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:32 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278" returned: 0 in 0.774s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:32 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278 Sep 09 14:50:32 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:32 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" returned: 0 in 0.441s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99af120a-ef54-45c7-9b81-7772f62636d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe2d13c-eacd-4fdf-9d1f-8c882c6a7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:32 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Volume volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 (cfc5cde0-1a69-4a3c-95ad-379e39d387d0): created successfully Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe2d13c-eacd-4fdf-9d1f-8c882c6a7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Flow 'volume_create_manager' (f9049962-460b-4396-ab19-44f31a20b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bcaf0837-45ad-4277-b892-460c3df4e700 tempest-SnapshotMetadataTestJSON-1886108918 None] Created volume successfully. Sep 09 14:50:32 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-82755c24-e3e0-4696-95c7-963fdea77278" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Lock "cinder-quobyte-82755c24-e3e0-4696-95c7-963fdea77278" released by "delete_volume" :: held 1.143s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Acquiring lock "cinder-25612d6a-5ba8-48d2-89f2-b3fb45244f7e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-25612d6a-5ba8-48d2-89f2-b3fb45244f7e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.quota [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Created reservations ['4b082383-3c1d-43a1-82b9-26d51222c8dd', '95f76a0c-c069-4be4-95c5-59de6dcefdc0', '133b81c4-3649-4759-b37c-716956c39279', '461bf9c4-a96a-4663-b05b-7c11e70045f8'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Acquiring lock "cinder-quobyte-25612d6a-5ba8-48d2-89f2-b3fb45244f7e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-quobyte-25612d6a-5ba8-48d2-89f2-b3fb45244f7e" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda23b08-a161-4b29-8b12-a6fa3a0e703d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:33 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:33 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:33 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e Sep 09 14:50:33 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:33 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:33 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e" returned: 0 in 0.431s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.manager [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Deleted volume successfully. Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:33 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e Sep 09 14:50:33 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Creating offline snapshot c4cda9de-5199-4b85-ab82-f85736ebc0bf of volume cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [req-648184ae-5eab-4b0b-9281-a89bc529f54a req-cd4ee5de-5f33-4dc0-a887-6669d0e2d1c7 tempest-TestShelveInstance-1499452957 None] Lock "cinder-82755c24-e3e0-4696-95c7-963fdea77278-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[41531a89-c34f-4c2c-a3df-1e4315148c38]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:33 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 Sep 09 14:50:33 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:33 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-25612d6a-5ba8-48d2-89f2-b3fb45244f7e" returned: 0 in 0.343s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-quobyte-25612d6a-5ba8-48d2-89f2-b3fb45244f7e" released by "delete_volume" :: held 0.852s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Created reservations ['994811fd-45c0-44f2-97a4-50f330605034', 'e20f4481-0e3e-47f2-a7a2-45a678064230', '95c0a371-c590-43a6-b145-9e8a5bfdbc13', '02403e77-e3e1-4679-938f-931f315e45fb'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:34 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" returned: 0 in 0.512s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:34 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:34 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:34 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf 1G Sep 09 14:50:34 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:34 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.477s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Deleted volume successfully. Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e373d7da-7824-47d7-9490-4beb475fb8ec tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-25612d6a-5ba8-48d2-89f2-b3fb45244f7e-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:34 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf 1G" returned: 0 in 0.643s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:34 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf Sep 09 14:50:34 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Flow 'volume_create_manager' (0302ea6e-1af5-40c0-a5f2-c6d5d549c1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5ca716-90e3-4602-80ce-2fc2c99b4bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5ca716-90e3-4602-80ce-2fc2c99b4bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1107873326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a61380-cf68-4393-b18e-3504df0e0464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9342077e6554026946eef027cea51cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:35Z,use_quota=True,user_id='a6b9851f5c4141de8c8b6884061bd23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da7b96e-fac1-4b09-97ca-c76d79761d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da7b96e-fac1-4b09-97ca-c76d79761d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4491254b-38f7-455a-8bf8-1bb062281caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4491254b-38f7-455a-8bf8-1bb062281caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a61380-cf68-4393-b18e-3504df0e0464', 'volume_name': 'volume-a3a61380-cf68-4393-b18e-3504df0e0464', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4785556-22c3-4dd4-9912-1b8f408ed49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4785556-22c3-4dd4-9912-1b8f408ed49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fd78a0-3998-4816-9f92-ed7e95af4b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:35 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Volume a3a61380-cf68-4393-b18e-3504df0e0464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a61380-cf68-4393-b18e-3504df0e0464', 'volume_size': 1} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:35 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:35 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf is being set with open permissions: ugo+rw Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:35 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf Sep 09 14:50:35 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:35 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf" returned: 0 in 0.341s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:35 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info Sep 09 14:50:35 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:35 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:35 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info is being set with open permissions: ugo+rw Sep 09 14:50:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:35 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info Sep 09 14:50:35 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:36 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.info" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1107873326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a61380-cf68-4393-b18e-3504df0e0464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9342077e6554026946eef027cea51cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:35Z,use_quota=True,user_id='a6b9851f5c4141de8c8b6884061bd23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Creating volume a3a61380-cf68-4393-b18e-3504df0e0464 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:36 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:36 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 1073741824 Sep 09 14:50:36 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:36 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-51c1997f-2d0b-4b23-beef-df707e73ef4b tempest-SnapshotMetadataTestJSON-1886108918 None] Create snapshot completed successfully Sep 09 14:50:36 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 1073741824" returned: 0 in 0.585s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:36 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 Sep 09 14:50:36 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:37 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fd78a0-3998-4816-9f92-ed7e95af4b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a61380-cf68-4393-b18e-3504df0e0464', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97d6870-7b06-4934-8bee-59aefc7ffdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:37 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Volume volume-a3a61380-cf68-4393-b18e-3504df0e0464 (a3a61380-cf68-4393-b18e-3504df0e0464): created successfully Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97d6870-7b06-4934-8bee-59aefc7ffdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Flow 'volume_create_manager' (0302ea6e-1af5-40c0-a5f2-c6d5d549c1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-441577fa-8aed-414d-a6a0-80cede9431eb tempest-VolumesTransfersV355Test-848611607 None] Created volume successfully. Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "cinder-c4cda9de-5199-4b85-ab82-f85736ebc0bf-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-c4cda9de-5199-4b85-ab82-f85736ebc0bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "cinder-quobyte-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-quobyte-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "cinder-quobyte-c4cda9de-5199-4b85-ab82-f85736ebc0bf" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-quobyte-c4cda9de-5199-4b85-ab82-f85736ebc0bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Deleting offline snapshot c4cda9de-5199-4b85-ab82-f85736ebc0bf of volume cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] snapshot_file for this snap is: volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc82a7b-3b90-4202-93c3-bf2d63bdc6f7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:38 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf Sep 09 14:50:38 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:38 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf" returned: 0 in 0.512s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ac7dbc-c4ef-45a9-a93f-3c7807d79536]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:38 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 Sep 09 14:50:38 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Acquiring lock "cinder-a3a61380-cf68-4393-b18e-3504df0e0464-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-a3a61380-cf68-4393-b18e-3504df0e0464-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Acquiring lock "cinder-quobyte-a3a61380-cf68-4393-b18e-3504df0e0464" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-quobyte-a3a61380-cf68-4393-b18e-3504df0e0464" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d49e96-0bf4-4cd4-9df2-d9a04f04f0b1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:38 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" returned: 0 in 0.468s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:39 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 Sep 09 14:50:39 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:39 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf Sep 09 14:50:39 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:39 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464" returned: 0 in 0.551s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:39 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464 Sep 09 14:50:39 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:39 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf" returned: 0 in 0.545s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:39 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf Sep 09 14:50:39 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:39 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3a61380-cf68-4393-b18e-3504df0e0464" returned: 0 in 0.335s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-quobyte-a3a61380-cf68-4393-b18e-3504df0e0464" released by "delete_volume" :: held 0.950s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:39 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Created reservations ['e956747e-ffaa-4e44-87e9-e8064a81eefa', 'ecb3b0dc-ecd4-4b80-9d78-ea78bc5ac940', '4cea99f1-e8a1-47fe-98a3-03bced8d17c5', '6591544e-60bd-441b-a511-991b83406cf5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0.c4cda9de-5199-4b85-ab82-f85736ebc0bf" returned: 0 in 0.383s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-quobyte-c4cda9de-5199-4b85-ab82-f85736ebc0bf" released by "_delete_snapshot" :: held 2.111s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-quobyte-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" released by "delete_snapshot" :: held 2.149s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:40 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:40 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Created reservations ['99897c2e-7a4f-4811-9676-e128734c0f9c', '4a36c79a-2a5b-4dad-aa6c-3b7dc05e89db', '925a0d17-84e5-4e41-82ed-219403216c25', '4f766fa2-51f4-46f5-859e-e73e9cc2eefd'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Delete snapshot completed successfully. Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eda3cd41-5017-4e08-bd81-126370c3df9f tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-c4cda9de-5199-4b85-ab82-f85736ebc0bf-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:40 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.302s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Deleted volume successfully. Sep 09 14:50:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-54b45404-7833-4411-a47a-052bb82e5abf tempest-VolumesTransfersV355Test-1504646109 None] Lock "cinder-a3a61380-cf68-4393-b18e-3504df0e0464-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "cinder-cfc5cde0-1a69-4a3c-95ad-379e39d387d0-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-cfc5cde0-1a69-4a3c-95ad-379e39d387d0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "cinder-quobyte-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-quobyte-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f1c5e-20c7-41f7-b0bc-9553d2bb964d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:41 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 Sep 09 14:50:41 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:41 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" returned: 0 in 0.500s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:41 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0 Sep 09 14:50:41 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:42 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" returned: 0 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-quobyte-cfc5cde0-1a69-4a3c-95ad-379e39d387d0" released by "delete_volume" :: held 0.943s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Created reservations ['f6a68726-74e3-432d-95f9-49eaf1a01ab6', '538ca59b-f49a-46af-96cf-3ddaeebb5660', 'e25f6afb-6534-4f1e-acce-c309a637dbb8', 'db2aeab5-c70a-42d8-b6bf-90527d1296a0'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:42 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:42 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:42 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.312s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Deleted volume successfully. Sep 09 14:50:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c1083f62-bed7-499c-a5e1-637325802254 tempest-SnapshotMetadataTestJSON-1886108918 None] Lock "cinder-cfc5cde0-1a69-4a3c-95ad-379e39d387d0-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:52 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:52 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:INSERT=26,cinder:SELECT=75,cinder:UPDATE=112,cinder:DELETE=6 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:50:52 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:50:52 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=75,cinder:INSERT=35,cinder:UPDATE=90,cinder:DELETE=11 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:50:53 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Flow 'volume_create_manager' (20d7509d-cd21-41bb-8c8d-fe18acd589d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b0dc84-92e9-403c-9cbe-a54f54ac0fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b0dc84-92e9-403c-9cbe-a54f54ac0fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382887129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451bb772-65b6-4fcb-8662-fd5e683813fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d9dfa8d5e34760ae4cf8a3ac5c5158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:54Z,use_quota=True,user_id='7436eb83e5084b02a70341e160912b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960b04a8-c453-483e-8431-ba8a15f124ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960b04a8-c453-483e-8431-ba8a15f124ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6c382-4da1-4ad1-805c-c5af60474ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6c382-4da1-4ad1-805c-c5af60474ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451bb772-65b6-4fcb-8662-fd5e683813fd', 'volume_name': 'volume-451bb772-65b6-4fcb-8662-fd5e683813fd', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d699471f-5491-4647-af3f-2f41ff26bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d699471f-5491-4647-af3f-2f41ff26bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a78a87d-25bc-4b4c-afb2-d6b84b1c4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:54 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Volume 451bb772-65b6-4fcb-8662-fd5e683813fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451bb772-65b6-4fcb-8662-fd5e683813fd', 'volume_size': 1} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382887129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451bb772-65b6-4fcb-8662-fd5e683813fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d9dfa8d5e34760ae4cf8a3ac5c5158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:54Z,use_quota=True,user_id='7436eb83e5084b02a70341e160912b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Creating volume 451bb772-65b6-4fcb-8662-fd5e683813fd {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:50:54 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:54 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd 1073741824 Sep 09 14:50:54 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:54 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd 1073741824" returned: 0 in 0.666s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:54 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd Sep 09 14:50:54 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:55 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd" returned: 0 in 0.365s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a78a87d-25bc-4b4c-afb2-d6b84b1c4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451bb772-65b6-4fcb-8662-fd5e683813fd', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30767831-162e-44d9-8b01-5f8f2b951554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:55 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Volume volume-451bb772-65b6-4fcb-8662-fd5e683813fd (451bb772-65b6-4fcb-8662-fd5e683813fd): created successfully Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30767831-162e-44d9-8b01-5f8f2b951554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Flow 'volume_create_manager' (20d7509d-cd21-41bb-8c8d-fe18acd589d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d887ced-d451-435e-ab52-e6879c60f7ad tempest-VolumesTransfersV357Test-647563001 None] Created volume successfully. Sep 09 14:50:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-860e5cea-5edc-44c6-a300-9e7f3469d148 tempest-VolumesTransfersV357Test-1524180184 None] Transfer volume completed successfully. Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Flow 'volume_create_manager' (ab10327b-d2ab-47d3-9584-f47a2cc52466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04498ff2-7daa-4d34-b365-d2e8831f0fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04498ff2-7daa-4d34-b365-d2e8831f0fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52454bf-d655-49c9-ac5d-6aea6944a3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fafbb7aace64ecd9e5060f66b0e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:58Z,use_quota=True,user_id='252436a443084fd4a70412377faf4949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cf72836-b18f-4aa4-8c12-3eeb7f03c732),volume_type_id=5cf72836-b18f-4aa4-8c12-3eeb7f03c732)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8893a42b-24ed-4354-a88e-f85ac9d23c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8893a42b-24ed-4354-a88e-f85ac9d23c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ce6b9d-6e04-4681-a6f0-15b22807c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:57 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Acquiring lock "cinder-451bb772-65b6-4fcb-8662-fd5e683813fd-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-451bb772-65b6-4fcb-8662-fd5e683813fd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Acquiring lock "cinder-quobyte-451bb772-65b6-4fcb-8662-fd5e683813fd" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-quobyte-451bb772-65b6-4fcb-8662-fd5e683813fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ce6b9d-6e04-4681-a6f0-15b22807c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c52454bf-d655-49c9-ac5d-6aea6944a3d1', 'volume_name': 'volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1', 'volume_size': 1, 'image_id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cba70470-4ed7-4858-9699-16715f7ae90c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e20312ff1a859bf8122053e6d73e75a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fafbb7aace64ecd9e5060f66b0e38b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0e3748c84f0ec5c2415c3966be5edd52d65b21723774b6bbbe195041ebbf6473b2fd0255ab4bf949917ad475130f35927b05fc39f131d9fc9201278744a6019', 'id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'created_at': datetime.datetime(2026, 9, 9, 12, 50, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 50, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cba70470-4ed7-4858-9699-16715f7ae90c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda7cf25-1ec2-4d9e-8f16-30295d827aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda7cf25-1ec2-4d9e-8f16-30295d827aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70729f1a-bfb4-421d-9beb-bd6d5dab5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:50:58 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Volume c52454bf-d655-49c9-ac5d-6aea6944a3d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1', 'volume_size': 1, 'image_id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cba70470-4ed7-4858-9699-16715f7ae90c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e20312ff1a859bf8122053e6d73e75a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fafbb7aace64ecd9e5060f66b0e38b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0e3748c84f0ec5c2415c3966be5edd52d65b21723774b6bbbe195041ebbf6473b2fd0255ab4bf949917ad475130f35927b05fc39f131d9fc9201278744a6019', 'id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'created_at': datetime.datetime(2026, 9, 9, 12, 50, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 50, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cba70470-4ed7-4858-9699-16715f7ae90c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Trying to clone c52454bf-d655-49c9-ac5d-6aea6944a3d1 from image cba70470-4ed7-4858-9699-16715f7ae90c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cba70470-4ed7-4858-9699-16715f7ae90c', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf69e39-3f17-4d09-879c-4ab1f500113b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:50:58 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Image download 0.00 MB at 0.00 MB/s Sep 09 14:50:58 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd Sep 09 14:50:58 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea5ac84-6771-4b8d-8151-58d2b3444abf]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:58 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD Sep 09 14:50:58 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:58 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd" returned: 0 in 0.606s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:58 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd Sep 09 14:50:58 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:59 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:59 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD Sep 09 14:50:59 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:59 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-451bb772-65b6-4fcb-8662-fd5e683813fd" returned: 0 in 0.491s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-quobyte-451bb772-65b6-4fcb-8662-fd5e683813fd" released by "delete_volume" :: held 1.184s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Created reservations ['e3608051-03c5-4aa0-9d7c-d5ca40993c2b', '2c9a4d60-a9f3-4d78-829a-153cfd7b0e58', 'f60a9e3c-7420-4a18-8f93-d92c6b23604e', '1f56fbe2-f1a4-4355-9b53-cb86c4d7718b'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:50:59 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Temporary image cba70470-4ed7-4858-9699-16715f7ae90c is fetched for user 252436a443084fd4a70412377faf4949. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:59 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:50:59 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f7735b-319b-43b2-a6b4-17509db9b584]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:50:59 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD Sep 09 14:50:59 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:50:59 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:50:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Deleted volume successfully. Sep 09 14:50:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-21d08658-ddff-4d95-a9d9-5bb635117796 tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-451bb772-65b6-4fcb-8662-fd5e683813fd-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:00 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:00 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD Sep 09 14:51:00 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:00 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52454bf-d655-49c9-ac5d-6aea6944a3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fafbb7aace64ecd9e5060f66b0e38b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:50:58Z,use_quota=True,user_id='252436a443084fd4a70412377faf4949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cf72836-b18f-4aa4-8c12-3eeb7f03c732),volume_type_id=5cf72836-b18f-4aa4-8c12-3eeb7f03c732)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Creating volume c52454bf-d655-49c9-ac5d-6aea6944a3d1 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:00 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:00 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 1073741824 Sep 09 14:51:00 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Flow 'volume_create_manager' (fa828465-1bd8-4c46-92ab-6c1c363ccabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d41ba9-2c98-4209-bf3f-749a622c795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d41ba9-2c98-4209-bf3f-749a622c795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-762223167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba4f662-1b22-49ea-a816-a74c153724c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baab9b308f549bc9bb97fd99cb758ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:01Z,use_quota=True,user_id='51800b345bdf4a8696204504a586dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138939d5-f235-4e3c-bdc0-42c39b02953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138939d5-f235-4e3c-bdc0-42c39b02953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b336c76-390a-45ac-b125-e88c7dc6738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b336c76-390a-45ac-b125-e88c7dc6738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba4f662-1b22-49ea-a816-a74c153724c7', 'volume_name': 'volume-4ba4f662-1b22-49ea-a816-a74c153724c7', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee70ac97-58e6-43b3-9d92-fdacaf77d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee70ac97-58e6-43b3-9d92-fdacaf77d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8211434c-a27b-484f-bc3e-50cbfdc36fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Volume 4ba4f662-1b22-49ea-a816-a74c153724c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba4f662-1b22-49ea-a816-a74c153724c7', 'volume_size': 1} Sep 09 14:51:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Flow 'volume_create_manager' (fcce31c8-0c1d-405d-a3ac-bc0105ba681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:01 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8db07ad-d544-4af3-81eb-45cd93e7a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 1073741824" returned: 0 in 0.707s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8db07ad-d544-4af3-81eb-45cd93e7a45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-478564474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac38bd9-eb6c-470d-9da8-96daefdd161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d9dfa8d5e34760ae4cf8a3ac5c5158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:01Z,use_quota=True,user_id='7436eb83e5084b02a70341e160912b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc70a5d5-e80c-4181-851c-637f5dc819fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc70a5d5-e80c-4181-851c-637f5dc819fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27ca627-e6d3-4cd9-a406-3116360b66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27ca627-e6d3-4cd9-a406-3116360b66ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac38bd9-eb6c-470d-9da8-96daefdd161a', 'volume_name': 'volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dbe2ea-ddc6-43fd-bcb6-abaa8b870fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dbe2ea-ddc6-43fd-bcb6-abaa8b870fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7458e4-1308-4177-b758-f489e8bf1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:01 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Volume 7ac38bd9-eb6c-470d-9da8-96daefdd161a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a', 'volume_size': 1} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:01 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 Sep 09 14:51:01 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:01 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1" returned: 0 in 0.302s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-762223167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba4f662-1b22-49ea-a816-a74c153724c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baab9b308f549bc9bb97fd99cb758ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:01Z,use_quota=True,user_id='51800b345bdf4a8696204504a586dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Creating volume 4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:01 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:01 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 1073741824 Sep 09 14:51:01 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Attempting download of cba70470-4ed7-4858-9699-16715f7ae90c ((None, [{'url': 'file:///opt/stack/data/glance/images/cba70470-4ed7-4858-9699-16715f7ae90c', 'metadata': {}}])) to volume c52454bf-d655-49c9-ac5d-6aea6944a3d1. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfdc28d-8feb-4d53-9912-b6b0597b911a]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:01 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn Sep 09 14:51:01 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:02 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:02 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 1073741824" returned: 0 in 0.562s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn" returned: 0 in 0.430s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:02 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 Sep 09 14:51:02 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:02 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn Sep 09 14:51:02 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:02 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn" returned: 1 in 0.459s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba70470-4ed7-4858-9699-16715f7ae90c_2d0q5imn' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc261a3a-2b0a-47bc-8d1c-c6f4f6dae437]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:02 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7" returned: 0 in 0.391s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-478564474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac38bd9-eb6c-470d-9da8-96daefdd161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d9dfa8d5e34760ae4cf8a3ac5c5158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:01Z,use_quota=True,user_id='7436eb83e5084b02a70341e160912b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Creating volume 7ac38bd9-eb6c-470d-9da8-96daefdd161a {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:02 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8211434c-a27b-484f-bc3e-50cbfdc36fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba4f662-1b22-49ea-a816-a74c153724c7', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c279ceb6-e6a9-47f1-989f-fe147834d6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:02 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a 1073741824 Sep 09 14:51:02 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:02 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Volume volume-4ba4f662-1b22-49ea-a816-a74c153724c7 (4ba4f662-1b22-49ea-a816-a74c153724c7): created successfully Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c279ceb6-e6a9-47f1-989f-fe147834d6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Flow 'volume_create_manager' (fa828465-1bd8-4c46-92ab-6c1c363ccabd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:02 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD Sep 09 14:51:02 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f50909eb-dae9-45d1-aee7-13b01a61b7d2 tempest-SnapshotDependencyTests-464414142 None] Created volume successfully. Sep 09 14:51:03 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:03 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD Sep 09 14:51:03 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:03 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a 1073741824" returned: 0 in 0.729s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:03 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a Sep 09 14:51:03 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:03 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] cba70470-4ed7-4858-9699-16715f7ae90c was raw, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:03 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 Sep 09 14:51:03 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:03 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7458e4-1308-4177-b758-f489e8bf1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34771a3f-1498-4ed5-9f2b-a71c9bd3cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:03 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Volume volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a (7ac38bd9-eb6c-470d-9da8-96daefdd161a): created successfully Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34771a3f-1498-4ed5-9f2b-a71c9bd3cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Flow 'volume_create_manager' (fcce31c8-0c1d-405d-a3ac-bc0105ba681d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a2567a6b-4fc6-4d0a-a1a9-dcd5d30186f0 tempest-VolumesTransfersV357Test-647563001 None] Created volume successfully. Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Creating offline snapshot be782200-d771-4595-8a87-407ec269c887 of volume 4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac02300-176e-4c5a-a50b-f171b8c14f04]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:04 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 Sep 09 14:51:04 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:04 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1" returned: 0 in 0.626s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cba70470-4ed7-4858-9699-16715f7ae90c__lyriiqidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:51:04 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:04 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 1G Sep 09 14:51:04 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Flow 'volume_create_manager' (e5481a0f-dde9-44ab-98fc-9954fe6ec7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f500b3-a5a2-417f-9654-5f3bb1a2f9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f500b3-a5a2-417f-9654-5f3bb1a2f9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2062983070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134ad91f-2e30-4905-8889-918453fd931c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d73a91ea26e4fe3918b5ae985fe1d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:04Z,use_quota=True,user_id='9bc59b6303444546a2a954b0836f5f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044ae3d9-a669-4f15-95cf-9b76a15dd0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044ae3d9-a669-4f15-95cf-9b76a15dd0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe118c1e-1662-402e-84df-fad2a0bf4c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe118c1e-1662-402e-84df-fad2a0bf4c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134ad91f-2e30-4905-8889-918453fd931c', 'volume_name': 'volume-134ad91f-2e30-4905-8889-918453fd931c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051d714e-c1d6-478a-a2e2-a111a2012747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051d714e-c1d6-478a-a2e2-a111a2012747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90cf503-e304-4902-86ee-c2e3f23285e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:04 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Volume 134ad91f-2e30-4905-8889-918453fd931c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134ad91f-2e30-4905-8889-918453fd931c', 'volume_size': 1} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:04 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7" returned: 0 in 0.455s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:04 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 1G Sep 09 14:51:04 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:04 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 1G" returned: 0 in 0.383s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Downloaded image cba70470-4ed7-4858-9699-16715f7ae90c ((None, [{'url': 'file:///opt/stack/data/glance/images/cba70470-4ed7-4858-9699-16715f7ae90c', 'metadata': {}}])) to volume c52454bf-d655-49c9-ac5d-6aea6944a3d1 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Temporary image cba70470-4ed7-4858-9699-16715f7ae90c for user 252436a443084fd4a70412377faf4949 is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Marking volume c52454bf-d655-49c9-ac5d-6aea6944a3d1 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Copying metadata from image cba70470-4ed7-4858-9699-16715f7ae90c to c52454bf-d655-49c9-ac5d-6aea6944a3d1. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Creating volume glance metadata for volume c52454bf-d655-49c9-ac5d-6aea6944a3d1 backed by image cba70470-4ed7-4858-9699-16715f7ae90c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e20312ff1a859bf8122053e6d73e75a7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70729f1a-bfb4-421d-9beb-bd6d5dab5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1', 'volume_size': 1, 'image_id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cba70470-4ed7-4858-9699-16715f7ae90c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e20312ff1a859bf8122053e6d73e75a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fafbb7aace64ecd9e5060f66b0e38b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0e3748c84f0ec5c2415c3966be5edd52d65b21723774b6bbbe195041ebbf6473b2fd0255ab4bf949917ad475130f35927b05fc39f131d9fc9201278744a6019', 'id': 'cba70470-4ed7-4858-9699-16715f7ae90c', 'created_at': datetime.datetime(2026, 9, 9, 12, 50, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 50, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cba70470-4ed7-4858-9699-16715f7ae90c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8dbbdf-39e4-4fa1-91f4-a968506d05c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Acquiring lock "cinder-7ac38bd9-eb6c-470d-9da8-96daefdd161a-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:04 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Volume volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 (c52454bf-d655-49c9-ac5d-6aea6944a3d1): created successfully Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8dbbdf-39e4-4fa1-91f4-a968506d05c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Flow 'volume_create_manager' (ab10327b-d2ab-47d3-9584-f47a2cc52466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-7ac38bd9-eb6c-470d-9da8-96daefdd161a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:04 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-48623e0c-e823-46be-97b3-46b162093bc4 tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Created volume successfully. Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Acquiring lock "cinder-quobyte-7ac38bd9-eb6c-470d-9da8-96daefdd161a" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-quobyte-7ac38bd9-eb6c-470d-9da8-96daefdd161a" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea4720-8c58-4813-a7c7-479dd4153d61]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:04 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a Sep 09 14:51:04 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 1G" returned: 0 in 0.472s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba4f662-1b22-49ea-a816-a74c153724c7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba4f662-1b22-49ea-a816-a74c153724c7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 Sep 09 14:51:05 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a Sep 09 14:51:05 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba4f662-1b22-49ea-a816-a74c153724c7 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887" returned: 0 in 0.336s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:05 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 is being set with open permissions: ugo+rw Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 Sep 09 14:51:05 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Acquiring lock "cinder-c52454bf-d655-49c9-ac5d-6aea6944a3d1-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "cinder-c52454bf-d655-49c9-ac5d-6aea6944a3d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Acquiring lock "cinder-quobyte-c52454bf-d655-49c9-ac5d-6aea6944a3d1" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "cinder-quobyte-c52454bf-d655-49c9-ac5d-6aea6944a3d1" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:05 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7ac38bd9-eb6c-470d-9da8-96daefdd161a" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[028d020d-b6eb-4bac-b293-33135714e1dd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-quobyte-7ac38bd9-eb6c-470d-9da8-96daefdd161a" released by "delete_volume" :: held 0.733s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Created reservations ['42e560e0-a1c1-4e21-bc09-65b7c2cccac8', '67287c9b-dc6a-4d6e-b812-e490784f7083', '220c1e12-9af4-49cd-9465-8c125a4e4238', 'a7462172-eb69-4281-9765-749a02107458'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:05 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887" returned: 0 in 0.322s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:05 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 Sep 09 14:51:05 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:05 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info Sep 09 14:51:05 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1" returned: 0 in 0.400s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:05 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1 Sep 09 14:51:05 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:05 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.295s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Deleted volume successfully. Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f3a4a787-bf43-43c6-b146-098851a2242b tempest-VolumesTransfersV357Test-1143719746 None] Lock "cinder-7ac38bd9-eb6c-470d-9da8-96daefdd161a-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:06 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info" returned: 0 in 0.308s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:06 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info is being set with open permissions: ugo+rw Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:06 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info Sep 09 14:51:06 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:06 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c52454bf-d655-49c9-ac5d-6aea6944a3d1" returned: 0 in 0.286s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "cinder-quobyte-c52454bf-d655-49c9-ac5d-6aea6944a3d1" released by "delete_volume" :: held 0.752s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:06 devstack cinder-volume[87325]: WARNING cinder.quota [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:51:06 devstack cinder-volume[87325]: WARNING cinder.quota [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:51:06 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.info" returned: 0 in 0.271s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2062983070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134ad91f-2e30-4905-8889-918453fd931c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d73a91ea26e4fe3918b5ae985fe1d8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:04Z,use_quota=True,user_id='9bc59b6303444546a2a954b0836f5f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Creating volume 134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:06 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Created reservations ['cbe4ba60-8d19-45c2-812b-476231b23889', 'ea694a34-c564-4a4e-88c6-4a7d5254e50c', 'dc66771b-f1ee-42df-bc16-4fff22ff27bd', 'cf61f400-418b-4370-8afc-0a63d54e06c9'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:06 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c 1073741824 Sep 09 14:51:06 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3709cbc1-199b-4328-949a-54bb1dd2c761 tempest-SnapshotDependencyTests-464414142 None] Create snapshot completed successfully Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:06 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:06 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:06 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Deleted volume successfully. Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b674a020-f1b8-449c-b545-c0ed6a498cbe tempest-VolumeAndVolumeTypeFromImageTest-486227876 None] Lock "cinder-c52454bf-d655-49c9-ac5d-6aea6944a3d1-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:06 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c 1073741824" returned: 0 in 0.550s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:06 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:51:06 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:07 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90cf503-e304-4902-86ee-c2e3f23285e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134ad91f-2e30-4905-8889-918453fd931c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b79f608-d02f-4083-a97b-fca3a541f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:07 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Volume volume-134ad91f-2e30-4905-8889-918453fd931c (134ad91f-2e30-4905-8889-918453fd931c): created successfully Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b79f608-d02f-4083-a97b-fca3a541f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Flow 'volume_create_manager' (e5481a0f-dde9-44ab-98fc-9954fe6ec7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:07 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d8b4155f-35f9-423a-b332-2d709dac26d0 tempest-VolumesActionsTest-703515910 None] Created volume successfully. Sep 09 14:51:07 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Flow 'volume_create_manager' (8bac753c-21ee-4772-bbe9-a0c6e4d29b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcfdd8-2c05-46d8-bca5-b3da16dc7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcfdd8-2c05-46d8-bca5-b3da16dc7804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7317b637-ea3e-4acb-b416-121e374c71f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baab9b308f549bc9bb97fd99cb758ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be782200-d771-4595-8a87-407ec269c887,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:08Z,use_quota=True,user_id='51800b345bdf4a8696204504a586dafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96b395b-dda0-4dde-bb24-27603309aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96b395b-dda0-4dde-bb24-27603309aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e1f4d9-58e8-4b7d-9c00-cdaadf9e8e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e1f4d9-58e8-4b7d-9c00-cdaadf9e8e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7317b637-ea3e-4acb-b416-121e374c71f4', 'volume_name': 'volume-7317b637-ea3e-4acb-b416-121e374c71f4', 'volume_size': 1, 'snapshot_id': 'be782200-d771-4595-8a87-407ec269c887'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aef86b9-2ab5-4123-a911-4b653e6649a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aef86b9-2ab5-4123-a911-4b653e6649a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48212e4d-353c-4fab-bfe0-8b31afc89aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:08 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Volume 7317b637-ea3e-4acb-b416-121e374c71f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7317b637-ea3e-4acb-b416-121e374c71f4', 'volume_size': 1, 'snapshot_id': 'be782200-d771-4595-8a87-407ec269c887'} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-quobyte-be782200-d771-4595-8a87-407ec269c887-7317b637-ea3e-4acb-b416-121e374c71f4" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-be782200-d771-4595-8a87-407ec269c887-7317b637-ea3e-4acb-b416-121e374c71f4" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Creating volume 7317b637-ea3e-4acb-b416-121e374c71f4 from snapshot be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-quobyte-7317b637-ea3e-4acb-b416-121e374c71f4" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-7317b637-ea3e-4acb-b416-121e374c71f4" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] snapshot: be782200-d771-4595-8a87-407ec269c887, volume: 7317b637-ea3e-4acb-b416-121e374c71f4, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9bd70-06f7-45c0-b11d-778516080041]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:08 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 Sep 09 14:51:08 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:08 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887" returned: 0 in 0.439s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba4f662-1b22-49ea-a816-a74c153724c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25e2b2-7560-423b-a33c-3e7e404976f7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:08 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 Sep 09 14:51:08 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:09 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7" returned: 0 in 0.492s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:51:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:51:09 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:51:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:09 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 Sep 09 14:51:09 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:16 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4" returned: 0 in 6.994s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:51:16 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Converted 1024.00 MB image at 146.38 MB/s Sep 09 14:51:16 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 is being set with open permissions: ugo+rw Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:16 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 Sep 09 14:51:16 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:16 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-7317b637-ea3e-4acb-b416-121e374c71f4" released by "_copy_volume_from_snapshot" :: held 8.454s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-be782200-d771-4595-8a87-407ec269c887-7317b637-ea3e-4acb-b416-121e374c71f4" released by "_create_volume_from_snapshot" :: held 8.559s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.581s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48212e4d-353c-4fab-bfe0-8b31afc89aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7317b637-ea3e-4acb-b416-121e374c71f4', 'volume_size': 1, 'snapshot_id': 'be782200-d771-4595-8a87-407ec269c887'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c615d21d-8eed-4fc3-855b-92687c084bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:16 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Volume volume-7317b637-ea3e-4acb-b416-121e374c71f4 (7317b637-ea3e-4acb-b416-121e374c71f4): created successfully Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c615d21d-8eed-4fc3-855b-92687c084bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Flow 'volume_create_manager' (8bac753c-21ee-4772-bbe9-a0c6e4d29b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0013376c-cb09-4216-a7dc-39da4f506983 tempest-SnapshotDependencyTests-464414142 None] Created volume successfully. Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-be782200-d771-4595-8a87-407ec269c887-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-be782200-d771-4595-8a87-407ec269c887-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-quobyte-4ba4f662-1b22-49ea-a816-a74c153724c7" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-4ba4f662-1b22-49ea-a816-a74c153724c7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-quobyte-be782200-d771-4595-8a87-407ec269c887" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-be782200-d771-4595-8a87-407ec269c887" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Deleting offline snapshot be782200-d771-4595-8a87-407ec269c887 of volume 4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] snapshot_file for this snap is: volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab35c1-4656-440a-8200-282363c1eed5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:17 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 Sep 09 14:51:17 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:17 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887" returned: 0 in 0.533s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba4f662-1b22-49ea-a816-a74c153724c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[84127aa6-d181-4c64-b097-bd4aa0da8c4f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:18 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 Sep 09 14:51:18 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Flow 'volume_create_manager' (503ffa2e-0ffe-48ba-b936-3e5b9402e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bab3f7-873a-4ab8-b723-cd90f345ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bab3f7-873a-4ab8-b723-cd90f345ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603553856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4560ed8b-ac04-4a70-8cdf-894e3c632928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b761b09e294947a28d581146802ea662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:18Z,use_quota=True,user_id='4644834ee6e84ac680d0faa2479c1c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1cc034-d689-4803-bbb7-0432d114fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1cc034-d689-4803-bbb7-0432d114fa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3dfdc2-991c-4bb8-a70d-69b0591b03b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3dfdc2-991c-4bb8-a70d-69b0591b03b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4560ed8b-ac04-4a70-8cdf-894e3c632928', 'volume_name': 'volume-4560ed8b-ac04-4a70-8cdf-894e3c632928', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb56e21-44d8-4d45-ba76-9c4158a2d63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb56e21-44d8-4d45-ba76-9c4158a2d63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e5ed69-d7f2-4f29-baa0-0c27751bd66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Volume 4560ed8b-ac04-4a70-8cdf-894e3c632928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4560ed8b-ac04-4a70-8cdf-894e3c632928', 'volume_size': 1} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603553856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4560ed8b-ac04-4a70-8cdf-894e3c632928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b761b09e294947a28d581146802ea662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:18Z,use_quota=True,user_id='4644834ee6e84ac680d0faa2479c1c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Creating volume 4560ed8b-ac04-4a70-8cdf-894e3c632928 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:18 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:18 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 1073741824 Sep 09 14:51:18 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Flow 'volume_create_manager' (3b5649d9-c55a-4dde-8165-3e15b9d6ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940d7e9b-336b-4136-b9ba-333110c6084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940d7e9b-336b-4136-b9ba-333110c6084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-551924862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d06187-a7c2-4c63-a6f3-fbb4d805e60b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43357bcbdcd34e7893155103f60b437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:18Z,use_quota=True,user_id='bd04d2b7a7de4f2bac2080f6bf341e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54fb553-fe01-4b67-bab2-1f736d48bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54fb553-fe01-4b67-bab2-1f736d48bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b36bcd4-edd5-4c89-80fd-a366d6cc672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b36bcd4-edd5-4c89-80fd-a366d6cc672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d06187-a7c2-4c63-a6f3-fbb4d805e60b', 'volume_name': 'volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9277b62b-8a85-4037-82e3-691ad06eaef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9277b62b-8a85-4037-82e3-691ad06eaef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e65a30-ac1c-42c9-a4b2-69e3c5d431a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Volume 96d06187-a7c2-4c63-a6f3-fbb4d805e60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b', 'volume_size': 1} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7" returned: 0 in 0.804s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:18 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 Sep 09 14:51:18 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:19 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 1073741824" returned: 0 in 0.797s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:19 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 Sep 09 14:51:19 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:19 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887" returned: 0 in 0.763s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:19 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887 Sep 09 14:51:19 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:19 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928" returned: 0 in 0.633s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-551924862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d06187-a7c2-4c63-a6f3-fbb4d805e60b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43357bcbdcd34e7893155103f60b437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:18Z,use_quota=True,user_id='bd04d2b7a7de4f2bac2080f6bf341e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:19 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Creating volume 96d06187-a7c2-4c63-a6f3-fbb4d805e60b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:19 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7.be782200-d771-4595-8a87-407ec269c887" returned: 0 in 0.445s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e5ed69-d7f2-4f29-baa0-0c27751bd66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4560ed8b-ac04-4a70-8cdf-894e3c632928', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:19 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b 1073741824 Sep 09 14:51:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988ce668-3fb6-407c-bdcb-5f9e5fadd37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:19 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:20 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Volume volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 (4560ed8b-ac04-4a70-8cdf-894e3c632928): created successfully Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988ce668-3fb6-407c-bdcb-5f9e5fadd37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Flow 'volume_create_manager' (503ffa2e-0ffe-48ba-b936-3e5b9402e749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-be782200-d771-4595-8a87-407ec269c887" released by "_delete_snapshot" :: held 2.763s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-4ba4f662-1b22-49ea-a816-a74c153724c7" released by "delete_snapshot" :: held 2.807s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-55922f2f-fe35-483e-93cc-d303bda6b2fe tempest-ProjectReaderTests-1656438245 None] Created volume successfully. Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Created reservations ['d3dd2716-6f45-4adb-a1ff-6f5f8f7c9a5c', 'ea308045-7339-44d8-b700-c9c2a9eec155', '99193a58-b164-486f-915d-a4417ce19844', '064464a9-5843-4d7c-ba22-fc89a4eb9266'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Delete snapshot completed successfully. Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6c2cef8a-d373-4e55-b20b-d2ae9bf8a8ce tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-be782200-d771-4595-8a87-407ec269c887-delete_snapshot" released by "delete_snapshot" :: held 2.990s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-4ba4f662-1b22-49ea-a816-a74c153724c7-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:20 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b 1073741824" returned: 0 in 0.793s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-4ba4f662-1b22-49ea-a816-a74c153724c7-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:20 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b Sep 09 14:51:20 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Acquiring lock "cinder-4560ed8b-ac04-4a70-8cdf-894e3c632928-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-quobyte-4ba4f662-1b22-49ea-a816-a74c153724c7" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-4ba4f662-1b22-49ea-a816-a74c153724c7" acquired by "delete_volume" :: waited 0.047s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-4560ed8b-ac04-4a70-8cdf-894e3c632928-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1794932b-270d-458b-a87e-0f6ef3efbcea]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Acquiring lock "cinder-quobyte-4560ed8b-ac04-4a70-8cdf-894e3c632928" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-quobyte-4560ed8b-ac04-4a70-8cdf-894e3c632928" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1337f3d-fa45-4d56-8eaf-d5939a9baef3]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:21 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 Sep 09 14:51:21 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:21 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e65a30-ac1c-42c9-a4b2-69e3c5d431a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefe1db2-2b66-4bfe-a0b9-17bbc6f4ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Volume volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b (96d06187-a7c2-4c63-a6f3-fbb4d805e60b): created successfully Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefe1db2-2b66-4bfe-a0b9-17bbc6f4ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Flow 'volume_create_manager' (3b5649d9-c55a-4dde-8165-3e15b9d6ac44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:21 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8e6210e3-c5fc-4f2b-a7b0-9a6fbc826e4a tempest-VolumesListTestJSON-486022864 None] Created volume successfully. Sep 09 14:51:21 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 Sep 09 14:51:21 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:21 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7" returned: 0 in 0.467s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:21 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7 Sep 09 14:51:21 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:21 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928" returned: 0 in 0.461s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:21 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928 Sep 09 14:51:21 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:21 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4ba4f662-1b22-49ea-a816-a74c153724c7" returned: 0 in 0.273s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-4ba4f662-1b22-49ea-a816-a74c153724c7" released by "delete_volume" :: held 0.846s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Created reservations ['b15d5144-c62c-489d-bfe8-f1e529f4b964', 'b511788c-8961-48fe-84d8-19158827d218', '884277aa-a8c8-43c9-82b9-d8a20f6a044f', '57279c61-7ae0-4c60-a1d4-8db4bf22d446'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:21 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4560ed8b-ac04-4a70-8cdf-894e3c632928" returned: 0 in 0.334s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-quobyte-4560ed8b-ac04-4a70-8cdf-894e3c632928" released by "delete_volume" :: held 0.895s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:22 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:22 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Created reservations ['a665d303-9415-4f32-bdec-8789f649cc24', '50140be3-e654-4c3b-bdf8-4b5448cf0b79', 'e909f4c1-32da-4f7e-b2fd-fdcb58b49f5d', '41f076fc-4725-4504-930e-e6baa7483e4c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:22 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:22 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:22 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.501s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Deleted volume successfully. Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a129c8f4-8bb9-426c-9f51-f0cde698af01 tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-4ba4f662-1b22-49ea-a816-a74c153724c7-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a3afe5bb-919b-4385-adbb-a8225b58dada tempest-VolumesActionsTest-703515910 None] Acquiring lock "cinder-134ad91f-2e30-4905-8889-918453fd931c" by "attach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a3afe5bb-919b-4385-adbb-a8225b58dada tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c" acquired by "attach_volume" :: waited 0.036s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:22 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.383s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Deleted volume successfully. Sep 09 14:51:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a3afe5bb-919b-4385-adbb-a8225b58dada tempest-VolumesActionsTest-703515910 None] Attaching volume 134ad91f-2e30-4905-8889-918453fd931c to instance 8a09dc3e-1f18-48b3-82e1-8e72040b21c1 at mountpoint /dev/vdb on host None. Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5c0091f3-8b7f-4a47-89c1-a9ca50c84dd7 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-4560ed8b-ac04-4a70-8cdf-894e3c632928-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a3afe5bb-919b-4385-adbb-a8225b58dada tempest-VolumesActionsTest-703515910 None] Attach volume completed successfully. Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a3afe5bb-919b-4385-adbb-a8225b58dada tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c" released by "attach_volume" :: held 0.143s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a85b912-e00f-4d68-992b-64dc5182093f tempest-VolumesActionsTest-703515910 None] Acquiring lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-detach_volume" by "detach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a85b912-e00f-4d68-992b-64dc5182093f tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3a85b912-e00f-4d68-992b-64dc5182093f tempest-VolumesActionsTest-703515910 None] Detaching volume 134ad91f-2e30-4905-8889-918453fd931c from instance 8a09dc3e-1f18-48b3-82e1-8e72040b21c1. Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Flow 'volume_create_manager' (a4416a46-9aa1-4390-866c-d13153cd32f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a70da7-59c5-4b77-a5bd-d9ac3181f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-7317b637-ea3e-4acb-b416-121e374c71f4-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a70da7-59c5-4b77-a5bd-d9ac3181f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1392675693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55aace8a-2916-4626-b71e-021c369468a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43357bcbdcd34e7893155103f60b437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:23Z,use_quota=True,user_id='bd04d2b7a7de4f2bac2080f6bf341e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c974397f-1d9d-4dfe-8b54-7f21e9568682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c974397f-1d9d-4dfe-8b54-7f21e9568682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1adb92-8164-41f6-ac21-13cf251b1707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1adb92-8164-41f6-ac21-13cf251b1707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55aace8a-2916-4626-b71e-021c369468a1', 'volume_name': 'volume-55aace8a-2916-4626-b71e-021c369468a1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff14d8d4-2b49-4223-9429-a65c93dbb428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff14d8d4-2b49-4223-9429-a65c93dbb428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526db93b-0cfc-4020-a3ac-6c1d3f85aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Volume 55aace8a-2916-4626-b71e-021c369468a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55aace8a-2916-4626-b71e-021c369468a1', 'volume_size': 1} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1392675693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55aace8a-2916-4626-b71e-021c369468a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43357bcbdcd34e7893155103f60b437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:23Z,use_quota=True,user_id='bd04d2b7a7de4f2bac2080f6bf341e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Creating volume 55aace8a-2916-4626-b71e-021c369468a1 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:23 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-7317b637-ea3e-4acb-b416-121e374c71f4-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:23 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 1073741824 Sep 09 14:51:23 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3a85b912-e00f-4d68-992b-64dc5182093f tempest-VolumesActionsTest-703515910 None] Detach volume completed successfully. Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3a85b912-e00f-4d68-992b-64dc5182093f tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-detach_volume" released by "detach_volume" :: held 0.233s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "cinder-quobyte-7317b637-ea3e-4acb-b416-121e374c71f4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-7317b637-ea3e-4acb-b416-121e374c71f4" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cb6eb-bbac-4611-80ed-6718b66264d6]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:23 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 Sep 09 14:51:23 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:24 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4" returned: 0 in 0.687s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:24 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:24 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4 Sep 09 14:51:24 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Flow 'volume_create_manager' (efdd4cf9-3646-416c-aa20-2276a9b24e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88bc56b-84b5-4798-8ea5-d5291edc09e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 1073741824" returned: 0 in 0.990s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88bc56b-84b5-4798-8ea5-d5291edc09e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736976533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8a4c76-3145-4a17-aa6b-6a645f931158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b761b09e294947a28d581146802ea662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:24Z,use_quota=True,user_id='4644834ee6e84ac680d0faa2479c1c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b039ddb1-2638-432d-b226-6711df81de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b039ddb1-2638-432d-b226-6711df81de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0068cebe-03de-445b-84fc-8746da39ab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0068cebe-03de-445b-84fc-8746da39ab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8a4c76-3145-4a17-aa6b-6a645f931158', 'volume_name': 'volume-8c8a4c76-3145-4a17-aa6b-6a645f931158', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2ab283-62fc-40c5-95fc-f8d229e4353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2ab283-62fc-40c5-95fc-f8d229e4353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4259b84-05f3-42eb-9d15-f87e61f90a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Volume 8c8a4c76-3145-4a17-aa6b-6a645f931158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8a4c76-3145-4a17-aa6b-6a645f931158', 'volume_size': 1} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:24 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 Sep 09 14:51:24 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:24 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7317b637-ea3e-4acb-b416-121e374c71f4" returned: 0 in 0.368s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-quobyte-7317b637-ea3e-4acb-b416-121e374c71f4" released by "delete_volume" :: held 1.123s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Created reservations ['712ca031-0dac-4db1-b80f-6304ffa2cba5', 'e883d834-e7ee-44af-a9c1-46e3c103eb3d', '1d7dbede-d44d-492b-ab31-006f7e76f065', 'ef6d6af6-dfaf-43b8-9e4a-bd3da9dc16c1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:24 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:24 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:24 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1" returned: 0 in 0.316s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736976533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8a4c76-3145-4a17-aa6b-6a645f931158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b761b09e294947a28d581146802ea662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:24Z,use_quota=True,user_id='4644834ee6e84ac680d0faa2479c1c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Creating volume 8c8a4c76-3145-4a17-aa6b-6a645f931158 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:24 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:24 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 1073741824 Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526db93b-0cfc-4020-a3ac-6c1d3f85aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55aace8a-2916-4626-b71e-021c369468a1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:24 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b172db-5466-455c-876f-8c78b70ee78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Volume volume-55aace8a-2916-4626-b71e-021c369468a1 (55aace8a-2916-4626-b71e-021c369468a1): created successfully Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b172db-5466-455c-876f-8c78b70ee78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Flow 'volume_create_manager' (a4416a46-9aa1-4390-866c-d13153cd32f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-049d75cc-aa5b-43bd-9262-f2ca11a03d12 tempest-VolumesListTestJSON-486022864 None] Created volume successfully. Sep 09 14:51:24 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Deleted volume successfully. Sep 09 14:51:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-97576b79-89c9-4b2a-b942-6e728e2a525a tempest-SnapshotDependencyTests-464414142 None] Lock "cinder-7317b637-ea3e-4acb-b416-121e374c71f4-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:25 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 1073741824" returned: 0 in 0.752s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:25 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 Sep 09 14:51:25 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:25 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4259b84-05f3-42eb-9d15-f87e61f90a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8a4c76-3145-4a17-aa6b-6a645f931158', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbd06a7-09a9-4432-a15a-04432311e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Volume volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 (8c8a4c76-3145-4a17-aa6b-6a645f931158): created successfully Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbd06a7-09a9-4432-a15a-04432311e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Flow 'volume_create_manager' (efdd4cf9-3646-416c-aa20-2276a9b24e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Flow 'volume_create_manager' (db1a5f99-59b1-426b-a615-3e4bed71141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf85173-82e2-4828-aacc-9301f22caf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-bb0905da-80ff-4639-9bf8-bfa101504eca tempest-ProjectReaderTests-1656438245 None] Created volume successfully. Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf85173-82e2-4828-aacc-9301f22caf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-934465770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c69bcd1-5f2b-4997-afc7-229a114de76a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43357bcbdcd34e7893155103f60b437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:26Z,use_quota=True,user_id='bd04d2b7a7de4f2bac2080f6bf341e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ca2222-4eda-463e-9aa4-16735714a673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ca2222-4eda-463e-9aa4-16735714a673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc24816-2373-49fa-9685-17ea68bbe7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc24816-2373-49fa-9685-17ea68bbe7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c69bcd1-5f2b-4997-afc7-229a114de76a', 'volume_name': 'volume-5c69bcd1-5f2b-4997-afc7-229a114de76a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1932282-ed18-4dd0-918d-457f6ec6e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1932282-ed18-4dd0-918d-457f6ec6e760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0093207-f289-45d4-8139-d12acf650580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Volume 5c69bcd1-5f2b-4997-afc7-229a114de76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c69bcd1-5f2b-4997-afc7-229a114de76a', 'volume_size': 1} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-934465770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c69bcd1-5f2b-4997-afc7-229a114de76a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43357bcbdcd34e7893155103f60b437f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:51:26Z,use_quota=True,user_id='bd04d2b7a7de4f2bac2080f6bf341e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Creating volume 5c69bcd1-5f2b-4997-afc7-229a114de76a {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:51:26 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:26 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a 1073741824 Sep 09 14:51:26 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:26 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a 1073741824" returned: 0 in 0.507s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:26 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a Sep 09 14:51:26 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:26 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a" returned: 0 in 0.277s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0093207-f289-45d4-8139-d12acf650580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c69bcd1-5f2b-4997-afc7-229a114de76a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd6661f-ccf2-4170-8ef6-86eb45783dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:51:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Volume volume-5c69bcd1-5f2b-4997-afc7-229a114de76a (5c69bcd1-5f2b-4997-afc7-229a114de76a): created successfully Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd6661f-ccf2-4170-8ef6-86eb45783dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:51:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Flow 'volume_create_manager' (db1a5f99-59b1-426b-a615-3e4bed71141c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:51:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f44aa12f-2d17-40fb-9a83-651806804f05 tempest-VolumesListTestJSON-486022864 None] Created volume successfully. Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Acquiring lock "cinder-8c8a4c76-3145-4a17-aa6b-6a645f931158-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-8c8a4c76-3145-4a17-aa6b-6a645f931158-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Acquiring lock "cinder-quobyte-8c8a4c76-3145-4a17-aa6b-6a645f931158" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-quobyte-8c8a4c76-3145-4a17-aa6b-6a645f931158" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e192ec9-00a8-49a8-a18f-17774a321b3b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:27 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 Sep 09 14:51:27 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:27 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158" returned: 0 in 0.404s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:27 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158 Sep 09 14:51:27 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:28 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8c8a4c76-3145-4a17-aa6b-6a645f931158" returned: 0 in 0.359s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-quobyte-8c8a4c76-3145-4a17-aa6b-6a645f931158" released by "delete_volume" :: held 0.820s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Created reservations ['f3c151b8-c97a-4cbc-8ca2-8f91d4fa1b0a', '1be0fb99-c25d-4df5-9161-a5250e5851dd', 'dcf00f34-7fd3-4e9a-af30-4832a73df392', '2be1d49c-3c7f-42a4-b6f7-b834de2a5c3d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:28 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:28 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:28 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.412s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Deleted volume successfully. Sep 09 14:51:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-51153b45-fe22-40bf-82ee-78bb39d0b060 tempest-ProjectReaderTests-1656438245 None] Lock "cinder-8c8a4c76-3145-4a17-aa6b-6a645f931158-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Acquiring lock "cinder-5c69bcd1-5f2b-4997-afc7-229a114de76a-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Lock "cinder-5c69bcd1-5f2b-4997-afc7-229a114de76a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Acquiring lock "cinder-quobyte-5c69bcd1-5f2b-4997-afc7-229a114de76a" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Lock "cinder-quobyte-5c69bcd1-5f2b-4997-afc7-229a114de76a" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f29f7-4f0f-454f-8012-879bb4e7e783]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:31 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a Sep 09 14:51:31 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:31 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a" returned: 0 in 0.474s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:31 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a Sep 09 14:51:31 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:32 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5c69bcd1-5f2b-4997-afc7-229a114de76a" returned: 0 in 0.396s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Lock "cinder-quobyte-5c69bcd1-5f2b-4997-afc7-229a114de76a" released by "delete_volume" :: held 0.937s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Created reservations ['3134e5a3-5ffa-4ac3-b967-b3cc4568a6d6', 'b36128d5-3b40-4df7-8a6d-17ab781dca7d', '6f780e6b-5c3d-42d8-a9cc-b75c729ac3c7', '50573830-e1b2-46f3-b35c-e3b473489437'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:32 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:32 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:32 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.300s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Deleted volume successfully. Sep 09 14:51:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-22286ada-dd1a-4b41-b7b8-6ebbe4426ddd tempest-VolumesListTestJSON-486022864 None] Lock "cinder-5c69bcd1-5f2b-4997-afc7-229a114de76a-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "cinder-55aace8a-2916-4626-b71e-021c369468a1-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Lock "cinder-55aace8a-2916-4626-b71e-021c369468a1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "cinder-quobyte-55aace8a-2916-4626-b71e-021c369468a1" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Lock "cinder-quobyte-55aace8a-2916-4626-b71e-021c369468a1" acquired by "delete_volume" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b59eac-530e-49d1-bc3f-1d3ddf854331]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:34 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 Sep 09 14:51:34 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:34 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1" returned: 0 in 0.714s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:34 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1 Sep 09 14:51:34 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:34 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-55aace8a-2916-4626-b71e-021c369468a1" returned: 0 in 0.465s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Lock "cinder-quobyte-55aace8a-2916-4626-b71e-021c369468a1" released by "delete_volume" :: held 1.315s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Created reservations ['49e9779f-00eb-40c2-9ff9-50ed9b84ca10', 'ada8a97d-902e-478b-a1f0-1c732acfd177', '4f201e07-98e1-472a-b4b3-9b3a7cb76b99', 'e9bc6e5a-e6f6-4e16-ad13-4845b9471eba'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:35 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:35 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:35 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.354s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Deleted volume successfully. Sep 09 14:51:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-76d35779-75e6-4922-a834-5c89a1aadce2 tempest-VolumesListTestJSON-486022864 None] Lock "cinder-55aace8a-2916-4626-b71e-021c369468a1-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Acquiring lock "cinder-96d06187-a7c2-4c63-a6f3-fbb4d805e60b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Lock "cinder-96d06187-a7c2-4c63-a6f3-fbb4d805e60b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Acquiring lock "cinder-quobyte-96d06187-a7c2-4c63-a6f3-fbb4d805e60b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Lock "cinder-quobyte-96d06187-a7c2-4c63-a6f3-fbb4d805e60b" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:36 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a71bf-9b40-4329-85be-702ab47622df]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:36 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b Sep 09 14:51:36 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:37 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b" returned: 0 in 0.504s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:37 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b Sep 09 14:51:37 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:37 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-96d06187-a7c2-4c63-a6f3-fbb4d805e60b" returned: 0 in 0.327s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Lock "cinder-quobyte-96d06187-a7c2-4c63-a6f3-fbb4d805e60b" released by "delete_volume" :: held 0.909s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Created reservations ['0971bdf5-408a-479c-818b-442a98145770', '5d9ea6dd-fa9b-44ba-ab79-efc3253bed6a', 'f44492a6-0a60-483a-9773-9d4772619a46', '3141dd24-886c-4fd0-b904-34579ecb5705'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:37 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:37 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fe0fb2f6-de36-4308-92fb-12e29cdec5a8 tempest-VolumesActionsTest-703515910 None] Acquiring lock "cinder-134ad91f-2e30-4905-8889-918453fd931c" by "attach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:38 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fe0fb2f6-de36-4308-92fb-12e29cdec5a8 tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c" acquired by "attach_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.346s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Deleted volume successfully. Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4aeff953-4f20-49f5-8980-9b954986cffa tempest-VolumesListTestJSON-486022864 None] Lock "cinder-96d06187-a7c2-4c63-a6f3-fbb4d805e60b-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-fe0fb2f6-de36-4308-92fb-12e29cdec5a8 tempest-VolumesActionsTest-703515910 None] Attaching volume 134ad91f-2e30-4905-8889-918453fd931c to instance fcbfbaf0-1a03-4103-b3ee-ceff4f74cef2 at mountpoint /dev/vdb on host None. Sep 09 14:51:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-fe0fb2f6-de36-4308-92fb-12e29cdec5a8 tempest-VolumesActionsTest-703515910 None] Attach volume completed successfully. Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fe0fb2f6-de36-4308-92fb-12e29cdec5a8 tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c" released by "attach_volume" :: held 0.127s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2061f8ea-3159-4ab4-853e-cc0ad72dc3fc tempest-VolumesActionsTest-703515910 None] Acquiring lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-detach_volume" by "detach_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:51:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2061f8ea-3159-4ab4-853e-cc0ad72dc3fc tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:51:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2061f8ea-3159-4ab4-853e-cc0ad72dc3fc tempest-VolumesActionsTest-703515910 None] Detaching volume 134ad91f-2e30-4905-8889-918453fd931c from instance fcbfbaf0-1a03-4103-b3ee-ceff4f74cef2. Sep 09 14:51:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2061f8ea-3159-4ab4-853e-cc0ad72dc3fc tempest-VolumesActionsTest-703515910 None] Detach volume completed successfully. Sep 09 14:51:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2061f8ea-3159-4ab4-853e-cc0ad72dc3fc tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8961d3-574e-4353-8384-a05298f0d0a1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:44 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:51:44 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:44 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.379s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a873ecc-66a0-42a3-97ff-0e2eb62f6d0d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:44 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:51:44 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:45 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.374s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.c2d05dd0-25ef-440c-b420-2de6ec3e6bfd2qkqb7e3.img {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:45 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.c2d05dd0-25ef-440c-b420-2de6ec3e6bfd2qkqb7e3.img Sep 09 14:51:45 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:49 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=94,cinder:INSERT=37,cinder:UPDATE=134,cinder:DELETE=13 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:51:49 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.c2d05dd0-25ef-440c-b420-2de6ec3e6bfd2qkqb7e3.img" returned: 0 in 4.686s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf96dcb-c4b3-4e81-988c-028d22ea7f59]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:51:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:49 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:51:49 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:50 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.546s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:50 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.c2d05dd0-25ef-440c-b420-2de6ec3e6bfd2qkqb7e3.img {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:51:50 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Converted 1024.00 MB image at 218.45 MB/s Sep 09 14:51:50 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] c2d05dd0-25ef-440c-b420-2de6ec3e6bfd was raw, no need to convert to raw {{(pid=87325) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:51:52 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:51:52 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:51:52 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.416s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:51:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:51:54 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=122,cinder:SELECT=112,cinder:DELETE=9,cinder:INSERT=33 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:52:00 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Flow 'volume_create_manager' (94017427-bd7f-4ab1-80b0-736566bfc654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23b6818-7c83-44e8-bf71-8837274d23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23b6818-7c83-44e8-bf71-8837274d23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1239440651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85839736-f1ac-4aad-8b7b-d02f04629301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e7078569634dc3b1ec7d9555468573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:11Z,use_quota=True,user_id='880399c72e174b4dade1110d43160f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8ed7de3-de21-42fc-91d2-34415d4d7280),volume_type_id=d8ed7de3-de21-42fc-91d2-34415d4d7280)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d218d96-e971-4f57-a150-ea66b22e819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d218d96-e971-4f57-a150-ea66b22e819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e39bd6-cc7e-4699-9d80-a1148398de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e39bd6-cc7e-4699-9d80-a1148398de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85839736-f1ac-4aad-8b7b-d02f04629301', 'volume_name': 'volume-85839736-f1ac-4aad-8b7b-d02f04629301', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3131947d-ed60-4ebf-9094-2934891ec834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3131947d-ed60-4ebf-9094-2934891ec834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c973e9ec-2fc0-40d3-be4a-98f11e1934ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume 85839736-f1ac-4aad-8b7b-d02f04629301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85839736-f1ac-4aad-8b7b-d02f04629301', 'volume_size': 1} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.143s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Uploaded volume to glance image-id: c2d05dd0-25ef-440c-b420-2de6ec3e6bfd. {{(pid=87325) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1239440651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85839736-f1ac-4aad-8b7b-d02f04629301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e7078569634dc3b1ec7d9555468573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:11Z,use_quota=True,user_id='880399c72e174b4dade1110d43160f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8ed7de3-de21-42fc-91d2-34415d4d7280),volume_type_id=d8ed7de3-de21-42fc-91d2-34415d4d7280)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Creating volume 85839736-f1ac-4aad-8b7b-d02f04629301 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:52:11 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:11 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 1073741824 Sep 09 14:52:11 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4446ecc4-6fe8-4220-a6cb-ec3852047ca5 tempest-VolumesActionsTest-703515910 None] Copy volume to image completed successfully. Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Flow 'volume_create_manager' (f4c85ce0-e841-4b08-9e0a-cbf776a59567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bba052-716f-49cd-a855-97aadf121545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bba052-716f-49cd-a855-97aadf121545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-660906268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb96add-e58a-40e8-a705-a73f71134f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e7078569634dc3b1ec7d9555468573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:11Z,use_quota=True,user_id='880399c72e174b4dade1110d43160f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(939c2e03-bf75-4e52-8ab5-99a34e385aba),volume_type_id=939c2e03-bf75-4e52-8ab5-99a34e385aba)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d21426-8a60-4fb4-8eb9-f375bca5d930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d21426-8a60-4fb4-8eb9-f375bca5d930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1bb33e-fde2-458f-bc8d-331084e799b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1bb33e-fde2-458f-bc8d-331084e799b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb96add-e58a-40e8-a705-a73f71134f50', 'volume_name': 'volume-1fb96add-e58a-40e8-a705-a73f71134f50', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5064d37-b3b8-489d-a903-14aee3bfbd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5064d37-b3b8-489d-a903-14aee3bfbd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c8acf1-08fc-46b1-91ea-efb3e38ddc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:11 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume 1fb96add-e58a-40e8-a705-a73f71134f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb96add-e58a-40e8-a705-a73f71134f50', 'volume_size': 1} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:11 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 1073741824" returned: 0 in 0.485s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:11 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Flow 'volume_create_manager' (124749a9-f694-4628-963a-8423f1ebed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc0c81a-8821-408d-aa6e-177cb46eb958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc0c81a-8821-408d-aa6e-177cb46eb958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-802059254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bb4ff7-24c2-4b64-b75b-b24d882281aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e7078569634dc3b1ec7d9555468573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:12Z,use_quota=True,user_id='880399c72e174b4dade1110d43160f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(966d1bb2-aaa1-4cae-9cb0-1a6ea95e8399),volume_type_id=966d1bb2-aaa1-4cae-9cb0-1a6ea95e8399)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:12 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 Sep 09 14:52:12 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a44e34-fbc1-4908-abc0-d2023d576e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a44e34-fbc1-4908-abc0-d2023d576e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330db578-0981-49bd-bba2-1c42d7db6d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:52:12 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301" returned: 0 in 0.271s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-660906268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb96add-e58a-40e8-a705-a73f71134f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e7078569634dc3b1ec7d9555468573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:11Z,use_quota=True,user_id='880399c72e174b4dade1110d43160f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(939c2e03-bf75-4e52-8ab5-99a34e385aba),volume_type_id=939c2e03-bf75-4e52-8ab5-99a34e385aba)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Creating volume 1fb96add-e58a-40e8-a705-a73f71134f50 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:52:12 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:12 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 1073741824 Sep 09 14:52:12 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c973e9ec-2fc0-40d3-be4a-98f11e1934ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85839736-f1ac-4aad-8b7b-d02f04629301', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a782601-72fe-4d95-a137-bc8a9eb2bee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330db578-0981-49bd-bba2-1c42d7db6d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49bb4ff7-24c2-4b64-b75b-b24d882281aa', 'volume_name': 'volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa', 'volume_size': 1, 'image_id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a7df205-7c14-457b-808a-07d682a8dbec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--672992864', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49e7078569634dc3b1ec7d9555468573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'created_at': datetime.datetime(2026, 9, 9, 12, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a7df205-7c14-457b-808a-07d682a8dbec/file', 'properties': {}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8664aa5-78af-467b-a99a-c905aff60dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8664aa5-78af-467b-a99a-c905aff60dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa2fb71-3a27-4716-9f81-36805769bab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:12 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume 49bb4ff7-24c2-4b64-b75b-b24d882281aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa', 'volume_size': 1, 'image_id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a7df205-7c14-457b-808a-07d682a8dbec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--672992864', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49e7078569634dc3b1ec7d9555468573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'created_at': datetime.datetime(2026, 9, 9, 12, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a7df205-7c14-457b-808a-07d682a8dbec/file', 'properties': {}}, 'image_service': } Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Trying to clone 49bb4ff7-24c2-4b64-b75b-b24d882281aa from image 9a7df205-7c14-457b-808a-07d682a8dbec at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a7df205-7c14-457b-808a-07d682a8dbec', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:52:12 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume volume-85839736-f1ac-4aad-8b7b-d02f04629301 (85839736-f1ac-4aad-8b7b-d02f04629301): created successfully Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a782601-72fe-4d95-a137-bc8a9eb2bee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Flow 'volume_create_manager' (94017427-bd7f-4ab1-80b0-736566bfc654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3ab19af0-7363-498f-9043-3f0c31afa70f tempest-TestInstancesWithCinderVolumes-1719947149 None] Created volume successfully. Sep 09 14:52:12 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 1073741824" returned: 0 in 0.514s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:12 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 Sep 09 14:52:12 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:13 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50" returned: 0 in 0.296s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c8acf1-08fc-46b1-91ea-efb3e38ddc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb96add-e58a-40e8-a705-a73f71134f50', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95dfc562-2f57-40ac-86c3-c43738966a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:13 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume volume-1fb96add-e58a-40e8-a705-a73f71134f50 (1fb96add-e58a-40e8-a705-a73f71134f50): created successfully Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95dfc562-2f57-40ac-86c3-c43738966a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Flow 'volume_create_manager' (f4c85ce0-e841-4b08-9e0a-cbf776a59567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e802b48b-73ef-401a-b9f5-d335b6f7dcbf tempest-TestInstancesWithCinderVolumes-1719947149 None] Created volume successfully. Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[db101be7-d4de-45aa-b4de-c7b46fbc9973]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:13 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:52:13 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:13 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8019b8-e6cf-4052-95af-6a5e1e8e2ac3]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:13 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:52:13 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:14 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.380s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:14 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img Sep 09 14:52:14 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:16 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD, size 20.69 MB, duration 4.48 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:52:16 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Image download 20.69 MB at 4.62 MB/s Sep 09 14:52:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d844a-8655-49c4-a507-304eafb58851]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:17 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD Sep 09 14:52:17 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:17 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:17 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Temporary image 9a7df205-7c14-457b-808a-07d682a8dbec is fetched for user 880399c72e174b4dade1110d43160f5a. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:52:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[759639ab-66b6-4333-af50-8304f3af0c0e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:17 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD Sep 09 14:52:17 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:18 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:18 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img" returned: 0 in 4.540s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:18 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f527a-0375-4677-b6f3-29a147a7be19]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:18 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:52:18 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:19 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.503s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:52:19 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Converted 1024.00 MB image at 225.49 MB/s Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] a51dcf69-9a88-46f7-96f9-93e248c3902c was raw, converting to qcow2 {{(pid=87325) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b4a51-53b1-4666-96a0-34b09d3648e3]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:19 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img Sep 09 14:52:19 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:19 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img" returned: 0 in 0.315s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:19 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img Sep 09 14:52:19 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:19 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img" returned: 1 in 0.336s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:52:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:19 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0 Sep 09 14:52:19 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:20 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0" returned: 0 in 0.540s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:20 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Image conversion details: src /opt/stack/data/cinder/conversion/134ad91f-2e30-4905-8889-918453fd931c.temp_image.a51dcf69-9a88-46f7-96f9-93e248c3902cprko04ng.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:52:20 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 09 14:52:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e4612a-fcd8-4c49-b82d-00c02923d211]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:20 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0 Sep 09 14:52:20 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:20 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nahk9vj0" returned: 0 in 0.341s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.638s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Uploaded volume to glance image-id: a51dcf69-9a88-46f7-96f9-93e248c3902c. {{(pid=87325) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.792s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-802059254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bb4ff7-24c2-4b64-b75b-b24d882281aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e7078569634dc3b1ec7d9555468573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:12Z,use_quota=True,user_id='880399c72e174b4dade1110d43160f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(966d1bb2-aaa1-4cae-9cb0-1a6ea95e8399),volume_type_id=966d1bb2-aaa1-4cae-9cb0-1a6ea95e8399)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Creating volume 49bb4ff7-24c2-4b64-b75b-b24d882281aa {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:52:21 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:52:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:21 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa 1073741824 Sep 09 14:52:21 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:21 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d5c77ab8-1f06-46ff-a267-e28154288394 tempest-VolumesActionsTest-703515910 None] Copy volume to image completed successfully. Sep 09 14:52:22 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa 1073741824" returned: 0 in 0.426s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:22 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa Sep 09 14:52:22 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:22 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Attempting download of 9a7df205-7c14-457b-808a-07d682a8dbec ((None, [{'url': 'file:///opt/stack/data/glance/images/9a7df205-7c14-457b-808a-07d682a8dbec', 'metadata': {}}])) to volume 49bb4ff7-24c2-4b64-b75b-b24d882281aa. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[318e68e8-eb17-4ebc-a8b6-0f653f3a92ab]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:22 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c Sep 09 14:52:22 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:23 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c" returned: 0 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:23 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c Sep 09 14:52:23 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Acquiring lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:52:23 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c" returned: 1 in 0.353s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a7df205-7c14-457b-808a-07d682a8dbec_pqty5u_c' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8910dc2c-0bd4-4a06-8f67-a234d168e385]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Acquiring lock "cinder-quobyte-134ad91f-2e30-4905-8889-918453fd931c" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Lock "cinder-quobyte-134ad91f-2e30-4905-8889-918453fd931c" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf67f209-9b3f-4f9f-a2da-316dda6a8baa]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:23 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD Sep 09 14:52:23 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:23 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:52:23 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:23 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] 9a7df205-7c14-457b-808a-07d682a8dbec was qcow2, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:23 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa Sep 09 14:52:23 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:23 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.365s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:23 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c Sep 09 14:52:23 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:24 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-134ad91f-2e30-4905-8889-918453fd931c" returned: 0 in 0.277s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Lock "cinder-quobyte-134ad91f-2e30-4905-8889-918453fd931c" released by "delete_volume" :: held 0.687s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Created reservations ['b3722b6d-2080-495d-90f2-043383f89a9c', 'ce528897-85f9-4d44-b6d1-38c74a3e193f', '69ddcbb2-b1c4-4d1d-97bb-a847e8e6cc5c', '0ecdfa0e-682d-4bed-94d2-89ca71cb7e1d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:24 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:52:24 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:24 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:52:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Deleted volume successfully. Sep 09 14:52:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae11c96c-da02-4933-97ad-883f5f5fd820 tempest-VolumesActionsTest-703515910 None] Lock "cinder-134ad91f-2e30-4905-8889-918453fd931c-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:52:25 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa" returned: 0 in 1.772s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a7df205-7c14-457b-808a-07d682a8dbec_kcbu9rppdevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:52:25 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Converted 112.00 MB image at 63.17 MB/s Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:25 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa 1G Sep 09 14:52:25 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:25 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa 1G" returned: 0 in 0.316s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Downloaded image 9a7df205-7c14-457b-808a-07d682a8dbec ((None, [{'url': 'file:///opt/stack/data/glance/images/9a7df205-7c14-457b-808a-07d682a8dbec', 'metadata': {}}])) to volume 49bb4ff7-24c2-4b64-b75b-b24d882281aa successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Temporary image 9a7df205-7c14-457b-808a-07d682a8dbec for user 880399c72e174b4dade1110d43160f5a is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Marking volume 49bb4ff7-24c2-4b64-b75b-b24d882281aa as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Copying metadata from image 9a7df205-7c14-457b-808a-07d682a8dbec to 49bb4ff7-24c2-4b64-b75b-b24d882281aa. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Creating volume glance metadata for volume 49bb4ff7-24c2-4b64-b75b-b24d882281aa backed by image 9a7df205-7c14-457b-808a-07d682a8dbec with: {'image_id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'image_name': 'tempest-scenario-img--672992864', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa2fb71-3a27-4716-9f81-36805769bab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa', 'volume_size': 1, 'image_id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a7df205-7c14-457b-808a-07d682a8dbec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--672992864', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '49e7078569634dc3b1ec7d9555468573', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a7df205-7c14-457b-808a-07d682a8dbec', 'created_at': datetime.datetime(2026, 9, 9, 12, 52, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 52, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a7df205-7c14-457b-808a-07d682a8dbec/file', 'properties': {}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9d6e9f-18cf-4c30-9d9f-7afc80ee7aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Volume volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa (49bb4ff7-24c2-4b64-b75b-b24d882281aa): created successfully Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9d6e9f-18cf-4c30-9d9f-7afc80ee7aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Flow 'volume_create_manager' (124749a9-f694-4628-963a-8423f1ebed50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7ba9364f-f678-4f50-aa4c-94af75df03d3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Created volume successfully. Sep 09 14:52:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b706cd20-344f-42f0-884d-0132e527581e req-bd15edf2-d7b3-491c-8bd9-2c73f17bcb07 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b706cd20-344f-42f0-884d-0132e527581e req-bd15edf2-d7b3-491c-8bd9-2c73f17bcb07 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-b706cd20-344f-42f0-884d-0132e527581e req-bd15edf2-d7b3-491c-8bd9-2c73f17bcb07 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:29 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-b706cd20-344f-42f0-884d-0132e527581e req-bd15edf2-d7b3-491c-8bd9-2c73f17bcb07 tempest-TestInstancesWithCinderVolumes-1719947149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64b1da6a-e0bc-4ac8-979f-9b062a0c78dc', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:52:29 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-b706cd20-344f-42f0-884d-0132e527581e req-bd15edf2-d7b3-491c-8bd9-2c73f17bcb07 tempest-TestInstancesWithCinderVolumes-1719947149 None] attachment_update completed successfully. Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Flow 'volume_create_manager' (a73e85fc-29e1-4da5-8146-d30a0ac6b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee328be-208f-4b45-a2db-4888bbfac283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee328be-208f-4b45-a2db-4888bbfac283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1289634385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1d81d5-d411-4535-b2bb-d1a81f301189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d77c630e3a401883124fc4c37fb931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:33Z,use_quota=True,user_id='eaaffe2e7b764bc8ac6d6871fe37c751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6a8911-1b5b-498d-8ac3-2f62b9bbb4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6a8911-1b5b-498d-8ac3-2f62b9bbb4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e093192a-8850-4006-9206-f20658524e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e093192a-8850-4006-9206-f20658524e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1d81d5-d411-4535-b2bb-d1a81f301189', 'volume_name': 'volume-7b1d81d5-d411-4535-b2bb-d1a81f301189', 'volume_size': 2}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3353140b-7b74-4660-8638-f1f5803c73e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3353140b-7b74-4660-8638-f1f5803c73e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a537643-296c-4699-8e85-66765413c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:33 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Volume 7b1d81d5-d411-4535-b2bb-d1a81f301189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1d81d5-d411-4535-b2bb-d1a81f301189', 'volume_size': 2} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1289634385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1d81d5-d411-4535-b2bb-d1a81f301189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d77c630e3a401883124fc4c37fb931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:33Z,use_quota=True,user_id='eaaffe2e7b764bc8ac6d6871fe37c751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Creating volume 7b1d81d5-d411-4535-b2bb-d1a81f301189 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:52:33 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:52:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 2147483648 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:33 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 2147483648 Sep 09 14:52:33 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:34 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 2147483648" returned: 0 in 0.522s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:34 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 Sep 09 14:52:34 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:34 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a537643-296c-4699-8e85-66765413c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1d81d5-d411-4535-b2bb-d1a81f301189', 'volume_size': 2}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e766f77e-e9a6-4077-a2a2-1e5f1214709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:34 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Volume volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 (7b1d81d5-d411-4535-b2bb-d1a81f301189): created successfully Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e766f77e-e9a6-4077-a2a2-1e5f1214709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:34 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Flow 'volume_create_manager' (a73e85fc-29e1-4da5-8146-d30a0ac6b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-60e54667-b986-45f7-901a-65c1ef83e1f0 tempest-VolumesCloneNegativeTest-1098425305 None] Created volume successfully. Sep 09 14:52:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Acquiring lock "cinder-7b1d81d5-d411-4535-b2bb-d1a81f301189-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:52:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "cinder-7b1d81d5-d411-4535-b2bb-d1a81f301189-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:52:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Acquiring lock "cinder-quobyte-7b1d81d5-d411-4535-b2bb-d1a81f301189" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:52:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "cinder-quobyte-7b1d81d5-d411-4535-b2bb-d1a81f301189" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:52:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7aacaa-2e64-4b3d-a72b-03d2001e2fb9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:36 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 Sep 09 14:52:36 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:36 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189" returned: 0 in 0.439s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:36 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189 Sep 09 14:52:36 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:36 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-7b1d81d5-d411-4535-b2bb-d1a81f301189" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "cinder-quobyte-7b1d81d5-d411-4535-b2bb-d1a81f301189" released by "delete_volume" :: held 0.793s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Created reservations ['681f7bc0-6be7-4312-ba79-1218bb589eef', 'af5ef544-d0fb-49e8-be12-6b1ea4c55ad4', 'c3897b55-577a-420d-a150-56e634c0679c', 'bddd2e92-3671-4757-80e0-22cf797732ff'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:36 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:52:36 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:37 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.416s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:37 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:52:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Deleted volume successfully. Sep 09 14:52:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f36a0514-f60c-4faf-b0e9-b71b67162775 tempest-VolumesCloneNegativeTest-1098425305 None] Lock "cinder-7b1d81d5-d411-4535-b2bb-d1a81f301189-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:52:41 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:52:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Flow 'volume_create_manager' (e22c8173-2ee5-471e-bdd0-e9176cc53dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b931de54-6738-4ce9-8a53-5dff18900e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b931de54-6738-4ce9-8a53-5dff18900e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-595358080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849b23b4d59b47af98d9f7155835bdc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:42Z,use_quota=True,user_id='e4ad214b728f48afba043867947a858b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d651d0e0-f869-46ac-a6d1-1f131c3c74eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d651d0e0-f869-46ac-a6d1-1f131c3c74eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd67ced3-4eaf-4b1e-8589-c70cc291a27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd67ced3-4eaf-4b1e-8589-c70cc291a27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3', 'volume_name': 'volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e29d19-347c-4959-9b67-d3026c410927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e29d19-347c-4959-9b67-d3026c410927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f69553-62b5-46e6-9b01-2d7dcb2d81ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Volume 31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3', 'volume_size': 1} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-595358080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849b23b4d59b47af98d9f7155835bdc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:52:42Z,use_quota=True,user_id='e4ad214b728f48afba043867947a858b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Creating volume 31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:52:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:42 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 1073741824 Sep 09 14:52:42 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:42 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 1073741824" returned: 0 in 0.426s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:42 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 Sep 09 14:52:42 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:42 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f69553-62b5-46e6-9b01-2d7dcb2d81ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdc93b6-f3ef-4e45-8e42-487f477a86c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:52:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Volume volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 (31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3): created successfully Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdc93b6-f3ef-4e45-8e42-487f477a86c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:52:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Flow 'volume_create_manager' (e22c8173-2ee5-471e-bdd0-e9176cc53dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:52:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-629987ae-a8a1-4a03-a3aa-90b92b844613 tempest-VolumesNegativeTest-65483341 None] Created volume successfully. Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:52 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:52:52 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=35,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:52:52 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:52:52 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=30,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:52:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Acquiring lock "cinder-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:52:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Lock "cinder-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:52:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Acquiring lock "cinder-quobyte-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:52:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Lock "cinder-quobyte-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:52:58 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2962cecd-25d7-4205-908f-41923836a3e1]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:52:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:58 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 Sep 09 14:52:58 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:59 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:59 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3 Sep 09 14:52:59 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:59 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3" returned: 0 in 0.277s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Lock "cinder-quobyte-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3" released by "delete_volume" :: held 0.698s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Created reservations ['4dfb557a-c285-4ba3-a89d-4032c7c71e90', 'ba9d6dc3-a8aa-43ff-a6de-681804ffc687', '50007b12-3da0-4178-b607-48d3d7feed93', '74704558-07e7-4236-aacc-dd3bd7a38f42'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:52:59 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:52:59 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:52:59 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.274s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:52:59 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Deleted volume successfully. Sep 09 14:52:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8429f8dc-e453-4503-9284-0c69ae963a77 tempest-VolumesNegativeTest-65483341 None] Lock "cinder-31721b2f-4d4a-4a6b-9f2d-a79babf7a8a3-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-2b23af54-4aa2-4284-880f-ee8a6d2c897d req-89a4a27e-1443-43bd-b528-5c60855235b3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-2b23af54-4aa2-4284-880f-ee8a6d2c897d req-89a4a27e-1443-43bd-b528-5c60855235b3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-2b23af54-4aa2-4284-880f-ee8a6d2c897d req-89a4a27e-1443-43bd-b528-5c60855235b3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-2b23af54-4aa2-4284-880f-ee8a6d2c897d req-89a4a27e-1443-43bd-b528-5c60855235b3 tempest-TestInstancesWithCinderVolumes-1719947149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-85839736-f1ac-4aad-8b7b-d02f04629301', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '716f9843-ab48-482b-a5be-33f5d2604920', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:53:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-2b23af54-4aa2-4284-880f-ee8a6d2c897d req-89a4a27e-1443-43bd-b528-5c60855235b3 tempest-TestInstancesWithCinderVolumes-1719947149 None] attachment_update completed successfully. Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Flow 'volume_create_manager' (b5e815d2-adc6-4dcc-b23d-703540400d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9160fac5-bb7e-45d9-97c0-0703487f5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9160fac5-bb7e-45d9-97c0-0703487f5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-641757470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215f053e-1d4f-4ed6-9cf4-209dae0fd13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239393a6adcf48a89a726436f84aa956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:04Z,use_quota=True,user_id='d4f7908b7c4c453780744307a38bb535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06660532-fcef-4d94-8f3c-ce6cbffbf7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06660532-fcef-4d94-8f3c-ce6cbffbf7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1161736d-4131-4f8d-b3d8-86a14b004650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1161736d-4131-4f8d-b3d8-86a14b004650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215f053e-1d4f-4ed6-9cf4-209dae0fd13f', 'volume_name': 'volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f', 'volume_size': 2}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f51edd-231a-492a-977b-7b359d3ee8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f51edd-231a-492a-977b-7b359d3ee8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c56abac-cd12-403c-b082-e35143722da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:04 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Volume 215f053e-1d4f-4ed6-9cf4-209dae0fd13f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f', 'volume_size': 2} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-641757470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215f053e-1d4f-4ed6-9cf4-209dae0fd13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239393a6adcf48a89a726436f84aa956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:04Z,use_quota=True,user_id='d4f7908b7c4c453780744307a38bb535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Creating volume 215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:04 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f 2147483648 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:04 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f 2147483648 Sep 09 14:53:04 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-3f98b373-0e9d-4cc9-8802-0f8a96487c34 req-059efe0d-f467-4bdc-8da3-9bfcc19c4cb7 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:04 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f 2147483648" returned: 0 in 0.532s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:04 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f Sep 09 14:53:04 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:05 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" returned: 0 in 0.252s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-3f98b373-0e9d-4cc9-8802-0f8a96487c34 req-059efe0d-f467-4bdc-8da3-9bfcc19c4cb7 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.331s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c56abac-cd12-403c-b082-e35143722da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f', 'volume_size': 2}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68415ee7-2917-47b1-b85e-b62105072cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-3f98b373-0e9d-4cc9-8802-0f8a96487c34 req-059efe0d-f467-4bdc-8da3-9bfcc19c4cb7 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:05 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Volume volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f (215f053e-1d4f-4ed6-9cf4-209dae0fd13f): created successfully Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68415ee7-2917-47b1-b85e-b62105072cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Flow 'volume_create_manager' (b5e815d2-adc6-4dcc-b23d-703540400d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ec8f0b49-d716-4ee0-bc69-2866aed37d9e tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Created volume successfully. Sep 09 14:53:05 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-3f98b373-0e9d-4cc9-8802-0f8a96487c34 req-059efe0d-f467-4bdc-8da3-9bfcc19c4cb7 tempest-TestInstancesWithCinderVolumes-1719947149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-1fb96add-e58a-40e8-a705-a73f71134f50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '357741cd-971e-42d3-98dd-12961e4da9bb', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:53:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-3f98b373-0e9d-4cc9-8802-0f8a96487c34 req-059efe0d-f467-4bdc-8da3-9bfcc19c4cb7 tempest-TestInstancesWithCinderVolumes-1719947149 None] attachment_update completed successfully. Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Creating offline snapshot 4794d3d2-b715-489e-86dc-58decd24b0a2 of volume 215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcd347-5eb2-487f-a3dc-c119c5a833b3]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:06 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f Sep 09 14:53:06 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:06 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 2G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:06 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 2G Sep 09 14:53:06 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:07 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 2G" returned: 0 in 0.407s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:07 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 Sep 09 14:53:07 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:07 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2" returned: 0 in 0.325s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:07 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 is being set with open permissions: ugo+rw Sep 09 14:53:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:07 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 Sep 09 14:53:07 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:07 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2" returned: 0 in 0.271s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:07 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info Sep 09 14:53:07 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:08 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:08 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info is being set with open permissions: ugo+rw Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:08 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info Sep 09 14:53:08 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:08 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.info" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3f86942d-cb06-49ad-b09a-f13c17fd1b2c tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Create snapshot completed successfully Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "cinder-4794d3d2-b715-489e-86dc-58decd24b0a2-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-4794d3d2-b715-489e-86dc-58decd24b0a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "cinder-quobyte-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-quobyte-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "cinder-quobyte-4794d3d2-b715-489e-86dc-58decd24b0a2" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-quobyte-4794d3d2-b715-489e-86dc-58decd24b0a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Deleting offline snapshot 4794d3d2-b715-489e-86dc-58decd24b0a2 of volume 215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] snapshot_file for this snap is: volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0a93c5-59b5-4362-be17-c31a1777f2e0]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:08 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 Sep 09 14:53:08 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:09 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2" returned: 0 in 0.404s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce7829d-7ad9-4ba5-9b1d-fadb5355d137]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:09 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f Sep 09 14:53:09 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:09 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:09 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 Sep 09 14:53:09 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:09 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2" returned: 0 in 0.351s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:09 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2 Sep 09 14:53:09 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:10 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f.4794d3d2-b715-489e-86dc-58decd24b0a2" returned: 0 in 0.272s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-quobyte-4794d3d2-b715-489e-86dc-58decd24b0a2" released by "_delete_snapshot" :: held 1.490s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-quobyte-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" released by "delete_snapshot" :: held 1.515s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Created reservations ['27f4b73b-22c4-4c7c-8769-79e4474d235c', '175ff269-3d8a-44c6-827a-95ed361a3e9c', '4c5c3f4d-dd12-4c61-8c76-04a57392930a', 'a2a5b2c0-b241-47e4-ac2e-cb71d7216dff'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Delete snapshot completed successfully. Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4176008d-c2e1-458f-b61a-eda894d7cfde tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-4794d3d2-b715-489e-86dc-58decd24b0a2-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-11f100ba-a42b-4fa2-9dcc-c80e0712ecab req-131a8598-db68-49e8-b8ae-56c45e55a0a8 tempest-TestInstancesWithCinderVolumes-1719947149 None] Terminate volume connection completed successfully. Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-11f100ba-a42b-4fa2-9dcc-c80e0712ecab req-131a8598-db68-49e8-b8ae-56c45e55a0a8 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deleting attachment 716f9843-ab48-482b-a5be-33f5d2604920. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "cinder-215f053e-1d4f-4ed6-9cf4-209dae0fd13f-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-215f053e-1d4f-4ed6-9cf4-209dae0fd13f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "cinder-quobyte-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-quobyte-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e8ee43-20b7-42b7-b948-1e7cba52f35d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:11 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f Sep 09 14:53:11 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "cinder-85839736-f1ac-4aad-8b7b-d02f04629301-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-85839736-f1ac-4aad-8b7b-d02f04629301-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "cinder-quobyte-85839736-f1ac-4aad-8b7b-d02f04629301" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-quobyte-85839736-f1ac-4aad-8b7b-d02f04629301" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dc04f9-5cdc-422e-ba0a-f6be40eaf386]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:11 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 Sep 09 14:53:11 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:11 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" returned: 0 in 0.402s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:11 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f Sep 09 14:53:11 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:11 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301" returned: 0 in 0.390s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:11 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301 Sep 09 14:53:11 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:11 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-quobyte-215f053e-1d4f-4ed6-9cf4-209dae0fd13f" released by "delete_volume" :: held 0.742s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Created reservations ['2bc6471d-5cd1-4a8c-8f84-78241b12a2aa', '8e5f13fa-8ffb-4b37-b73b-ee8be0e9d09f', '4a516678-35a6-415b-8507-d03aec14f1f7', '773f0f31-a264-4824-b3c8-88d0cfe042f5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:11 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:11 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:11 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-85839736-f1ac-4aad-8b7b-d02f04629301" returned: 0 in 0.295s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-quobyte-85839736-f1ac-4aad-8b7b-d02f04629301" released by "delete_volume" :: held 0.734s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:11 devstack cinder-volume[87325]: WARNING cinder.quota [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387897134-109184165 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387897134-109184165, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:53:11 devstack cinder-volume[87325]: WARNING cinder.quota [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387897134-109184165 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387897134-109184165, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:53:11 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Created reservations ['b05c7b53-ae07-490a-9129-96d391acb03f', '4a688c9b-3486-4432-bb8e-7fe0c1f282b2', 'b2692ef6-7b95-467f-ab5b-fc17182d904e', 'd1ffbcfa-7843-4148-86c1-904bfe2168aa'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:12 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Deleted volume successfully. Sep 09 14:53:12 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:12 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8630bd1b-6896-4bda-add0-079c6b9aeef7 tempest-VolumesSnapshotNegativeTestJSON-42357665 None] Lock "cinder-215f053e-1d4f-4ed6-9cf4-209dae0fd13f-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:12 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.321s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:12 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deleted volume successfully. Sep 09 14:53:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d7aca469-8aa5-4fe2-a5d5-8412b36f9cb4 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-85839736-f1ac-4aad-8b7b-d02f04629301-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:14 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-6d2f1600-0906-44af-95cb-45b285ace7bd req-97765365-3853-496c-b6ec-ee7603757ed7 tempest-TestInstancesWithCinderVolumes-1719947149 None] Terminate volume connection completed successfully. Sep 09 14:53:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-6d2f1600-0906-44af-95cb-45b285ace7bd req-97765365-3853-496c-b6ec-ee7603757ed7 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deleting attachment 357741cd-971e-42d3-98dd-12961e4da9bb. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (4c46c73c-0917-4b38-b326-ba69b381a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804963a7-0fac-4ef5-a9c8-1f898779163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804963a7-0fac-4ef5-a9c8-1f898779163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478127209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49670079-c78d-4a03-9a8b-d5c8e448faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:15Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e2e5e4-7483-49c8-b201-841569f2edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e2e5e4-7483-49c8-b201-841569f2edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece04b7c-0b77-447f-b822-ebc769aec133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece04b7c-0b77-447f-b822-ebc769aec133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49670079-c78d-4a03-9a8b-d5c8e448faf3', 'volume_name': 'volume-49670079-c78d-4a03-9a8b-d5c8e448faf3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2f4065-bbab-4885-90dd-8187f0a83407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2f4065-bbab-4885-90dd-8187f0a83407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1042059b-0ca6-48ca-aa20-89b8db34ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:15 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume 49670079-c78d-4a03-9a8b-d5c8e448faf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49670079-c78d-4a03-9a8b-d5c8e448faf3', 'volume_size': 1} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478127209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49670079-c78d-4a03-9a8b-d5c8e448faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:15Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating volume 49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:15 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:15 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 1073741824 Sep 09 14:53:15 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "cinder-1fb96add-e58a-40e8-a705-a73f71134f50-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-1fb96add-e58a-40e8-a705-a73f71134f50-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "cinder-quobyte-1fb96add-e58a-40e8-a705-a73f71134f50" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-quobyte-1fb96add-e58a-40e8-a705-a73f71134f50" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4c16e8-f1eb-4bf8-8935-2407cc698d5f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:15 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 1073741824" returned: 0 in 0.502s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:15 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 Sep 09 14:53:15 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:15 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 Sep 09 14:53:15 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:16 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50" returned: 0 in 0.387s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:16 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50 Sep 09 14:53:16 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:16 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3" returned: 0 in 0.274s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1042059b-0ca6-48ca-aa20-89b8db34ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49670079-c78d-4a03-9a8b-d5c8e448faf3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff08add-1a8e-434f-b52d-fc79fbbe33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:16 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 (49670079-c78d-4a03-9a8b-d5c8e448faf3): created successfully Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff08add-1a8e-434f-b52d-fc79fbbe33e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (4c46c73c-0917-4b38-b326-ba69b381a43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-899bc9fe-6def-4153-b127-0b4d3632eb33 tempest-CreateVolumesFromSnapshotTest-258924953 None] Created volume successfully. Sep 09 14:53:16 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1fb96add-e58a-40e8-a705-a73f71134f50" returned: 0 in 0.280s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-quobyte-1fb96add-e58a-40e8-a705-a73f71134f50" released by "delete_volume" :: held 0.712s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:16 devstack cinder-volume[87325]: WARNING cinder.quota [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-494784769-68634857 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-494784769-68634857, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:53:16 devstack cinder-volume[87325]: WARNING cinder.quota [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-494784769-68634857 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-494784769-68634857, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Created reservations ['ae299f1a-0b79-4fc4-87fd-de18e47fe46d', 'f24018c8-6082-4adf-8b64-68cc11b7a35e', '7f70a7a0-db99-4d0b-9c14-401b7d0dd49a', '67880d1d-28ed-4fe7-a0d6-1d3bdf4238dd'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:16 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:16 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:16 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deleted volume successfully. Sep 09 14:53:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a6c347f-eaec-46f8-91b3-46350d734ae2 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-1fb96add-e58a-40e8-a705-a73f71134f50-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating offline snapshot 80d1bdff-8321-4466-b138-32481e74581b of volume 49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:53:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d654bf8b-605b-46cc-ab87-0d6a2385f96d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:17 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 Sep 09 14:53:17 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:18 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3" returned: 0 in 0.407s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:18 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b 1G Sep 09 14:53:18 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:18 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b 1G" returned: 0 in 0.568s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:18 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b Sep 09 14:53:18 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:19 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b" returned: 0 in 0.391s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:19 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b is being set with open permissions: ugo+rw Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:19 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b Sep 09 14:53:19 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:19 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:19 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info Sep 09 14:53:19 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:19 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info" returned: 0 in 0.314s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:19 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info is being set with open permissions: ugo+rw Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:19 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info Sep 09 14:53:19 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-a0c5b07e-6893-4ec0-acba-77adc7d9f625 req-23238e09-0ca2-485f-8a12-2f220a5b0fec tempest-TestInstancesWithCinderVolumes-1719947149 None] Terminate volume connection completed successfully. Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-a0c5b07e-6893-4ec0-acba-77adc7d9f625 req-23238e09-0ca2-485f-8a12-2f220a5b0fec tempest-TestInstancesWithCinderVolumes-1719947149 None] Deleting attachment 64b1da6a-e0bc-4ac8-979f-9b062a0c78dc. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:53:19 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.info" returned: 0 in 0.269s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-adba85c3-e66b-41ea-9cab-774ef0b90bbc tempest-CreateVolumesFromSnapshotTest-258924953 None] Create snapshot completed successfully Sep 09 14:53:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "cinder-49bb4ff7-24c2-4b64-b75b-b24d882281aa-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-49bb4ff7-24c2-4b64-b75b-b24d882281aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "cinder-quobyte-49bb4ff7-24c2-4b64-b75b-b24d882281aa" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-quobyte-49bb4ff7-24c2-4b64-b75b-b24d882281aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f322e75-5112-4cf9-92a0-3d9d6ccf3bad]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:20 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa Sep 09 14:53:20 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:21 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa" returned: 0 in 0.404s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:21 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa Sep 09 14:53:21 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (0b5c9cfb-abf1-4313-9705-c9c546f530e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1842a7a3-feeb-4d75-9dc5-cc14df2e0388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1842a7a3-feeb-4d75-9dc5-cc14df2e0388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136487390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0a783c-8104-4062-886e-f26035d6c8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:21Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50bb028-240d-4068-8572-9d55f1ea2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50bb028-240d-4068-8572-9d55f1ea2b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2390f270-fd82-4002-ab68-2a5b9b618c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2390f270-fd82-4002-ab68-2a5b9b618c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0a783c-8104-4062-886e-f26035d6c8c4', 'volume_name': 'volume-fe0a783c-8104-4062-886e-f26035d6c8c4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82bda68-0c2a-461c-9e50-2af3709b7d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82bda68-0c2a-461c-9e50-2af3709b7d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69cc81f-92fa-486a-89b2-acfc47ac58b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume fe0a783c-8104-4062-886e-f26035d6c8c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0a783c-8104-4062-886e-f26035d6c8c4', 'volume_size': 1} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136487390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0a783c-8104-4062-886e-f26035d6c8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:21Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating volume fe0a783c-8104-4062-886e-f26035d6c8c4 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:21 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:21 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 1073741824 Sep 09 14:53:21 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:21 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49bb4ff7-24c2-4b64-b75b-b24d882281aa" returned: 0 in 0.272s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-quobyte-49bb4ff7-24c2-4b64-b75b-b24d882281aa" released by "delete_volume" :: held 0.721s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:21 devstack cinder-volume[87325]: WARNING cinder.quota [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611631746-1948981743 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611631746-1948981743, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:53:21 devstack cinder-volume[87325]: WARNING cinder.quota [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611631746-1948981743 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611631746-1948981743, it is now deprecated. Please use the default quota class for default quota. Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Created reservations ['b6d96365-ce3c-4f1c-8a3c-42781a36feab', 'fb585735-9fad-437e-a89f-66dd27135e28', 'f2645005-27ad-4af7-9199-633c84c0201e', '20226524-568e-4a91-8763-a428ad673725'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (f9810ec5-d9a2-4621-8867-bd324a8c1899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:21 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:21 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a196b0f-2670-4a4d-87a9-7157146e68fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a196b0f-2670-4a4d-87a9-7157146e68fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220702979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06daef93-d42f-4a95-adc2-e6efc758a821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:22Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de8e8bb-9318-4299-b8d6-a65e17a60c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de8e8bb-9318-4299-b8d6-a65e17a60c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42809e41-4e53-4e94-b5cd-32a967c8e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42809e41-4e53-4e94-b5cd-32a967c8e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06daef93-d42f-4a95-adc2-e6efc758a821', 'volume_name': 'volume-06daef93-d42f-4a95-adc2-e6efc758a821', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdf3bc9-d32c-4aee-bcb6-aa8873f86585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdf3bc9-d32c-4aee-bcb6-aa8873f86585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20f22a2-37e9-4cfc-9089-c74e6130d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume 06daef93-d42f-4a95-adc2-e6efc758a821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06daef93-d42f-4a95-adc2-e6efc758a821', 'volume_size': 1} Sep 09 14:53:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:21 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 1073741824" returned: 0 in 0.627s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:22 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.368s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Deleted volume successfully. Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:22 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 Sep 09 14:53:22 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-204dfcf0-938c-4f7f-a324-3c23a8207c80 tempest-TestInstancesWithCinderVolumes-1719947149 None] Lock "cinder-49bb4ff7-24c2-4b64-b75b-b24d882281aa-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (2b9216a5-690f-442a-b0d5-81687d1e7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e12ebd-c086-4616-a631-24fe9a99eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e12ebd-c086-4616-a631-24fe9a99eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648140989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29239bae-7326-4123-97cb-90880ec9a4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:22Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252af608-9a0e-4bbe-865f-2f6eca51b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252af608-9a0e-4bbe-865f-2f6eca51b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e688ae5-1378-4e55-96e3-0a41d50d67c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e688ae5-1378-4e55-96e3-0a41d50d67c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29239bae-7326-4123-97cb-90880ec9a4a2', 'volume_name': 'volume-29239bae-7326-4123-97cb-90880ec9a4a2', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba13cfb3-fe06-4adc-87b1-e248c00dc2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba13cfb3-fe06-4adc-87b1-e248c00dc2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94a3571-9e52-4240-9e64-b8c2ea06220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume 29239bae-7326-4123-97cb-90880ec9a4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29239bae-7326-4123-97cb-90880ec9a4a2', 'volume_size': 1} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:22 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4" returned: 0 in 0.420s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220702979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06daef93-d42f-4a95-adc2-e6efc758a821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:22Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating volume 06daef93-d42f-4a95-adc2-e6efc758a821 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:22 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:22 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 1073741824 Sep 09 14:53:22 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69cc81f-92fa-486a-89b2-acfc47ac58b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0a783c-8104-4062-886e-f26035d6c8c4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ad34ee-e01a-4f17-ba50-c1a3612959f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume volume-fe0a783c-8104-4062-886e-f26035d6c8c4 (fe0a783c-8104-4062-886e-f26035d6c8c4): created successfully Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ad34ee-e01a-4f17-ba50-c1a3612959f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (0b5c9cfb-abf1-4313-9705-c9c546f530e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (200e705a-df41-43b0-861e-34f316529c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d284c2-a34e-4ac4-818a-d264a3bc1f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7db11cce-8cdf-4bab-b16b-575390667846 tempest-CreateVolumesFromSnapshotTest-258924953 None] Created volume successfully. Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d284c2-a34e-4ac4-818a-d264a3bc1f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64110181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4272ab06-c0ef-4095-b22a-b6b65f9964f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:23Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec42e4e0-f114-4160-b169-cfe532c0012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec42e4e0-f114-4160-b169-cfe532c0012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2cdcd4-11bd-4a05-8b5e-1ee0551d158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2cdcd4-11bd-4a05-8b5e-1ee0551d158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4272ab06-c0ef-4095-b22a-b6b65f9964f1', 'volume_name': 'volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c22a84c-9060-4d94-8bc4-2656143c7d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c22a84c-9060-4d94-8bc4-2656143c7d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ad9f67-da7b-492c-a8f3-13d30946e92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume 4272ab06-c0ef-4095-b22a-b6b65f9964f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1', 'volume_size': 1} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (4d1409f1-83f2-4f1d-8f0f-1a9f062482be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c446867-6a91-4834-9658-95fcea20b00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c446867-6a91-4834-9658-95fcea20b00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185126925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fc1ed9-c814-412b-9ddf-eabd0c347696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:23Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6ee777-d2a3-49f8-8b42-aa53a86491f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6ee777-d2a3-49f8-8b42-aa53a86491f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d080bc4-73c4-4f1c-b66e-4c04bbf6a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d080bc4-73c4-4f1c-b66e-4c04bbf6a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fc1ed9-c814-412b-9ddf-eabd0c347696', 'volume_name': 'volume-10fc1ed9-c814-412b-9ddf-eabd0c347696', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bbffa0-9966-434a-ac24-7ae05b852739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bbffa0-9966-434a-ac24-7ae05b852739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82e9d00-0a40-4a2f-b9bb-40317564e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume 10fc1ed9-c814-412b-9ddf-eabd0c347696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fc1ed9-c814-412b-9ddf-eabd0c347696', 'volume_size': 1} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:23 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 1073741824" returned: 0 in 0.598s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:23 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 Sep 09 14:53:23 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:23 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821" returned: 0 in 0.241s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648140989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29239bae-7326-4123-97cb-90880ec9a4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:22Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating volume 29239bae-7326-4123-97cb-90880ec9a4a2 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:23 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20f22a2-37e9-4cfc-9089-c74e6130d17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06daef93-d42f-4a95-adc2-e6efc758a821', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:23 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 1073741824 Sep 09 14:53:23 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d28bbf2-97d8-407a-b043-8022c3034bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume volume-06daef93-d42f-4a95-adc2-e6efc758a821 (06daef93-d42f-4a95-adc2-e6efc758a821): created successfully Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d28bbf2-97d8-407a-b043-8022c3034bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (f9810ec5-d9a2-4621-8867-bd324a8c1899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-561e5067-8ac8-4120-bf5c-1f3c06c59ba8 tempest-CreateVolumesFromSnapshotTest-258924953 None] Created volume successfully. Sep 09 14:53:23 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 1073741824" returned: 0 in 0.447s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:23 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 Sep 09 14:53:23 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:24 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64110181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4272ab06-c0ef-4095-b22a-b6b65f9964f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:23Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating volume 4272ab06-c0ef-4095-b22a-b6b65f9964f1 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:24 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94a3571-9e52-4240-9e64-b8c2ea06220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29239bae-7326-4123-97cb-90880ec9a4a2', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:24 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 1073741824 Sep 09 14:53:24 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2f00f0-7a0c-4778-96cf-43f1acceb176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume volume-29239bae-7326-4123-97cb-90880ec9a4a2 (29239bae-7326-4123-97cb-90880ec9a4a2): created successfully Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2f00f0-7a0c-4778-96cf-43f1acceb176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (2b9216a5-690f-442a-b0d5-81687d1e7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e3f6eacb-25a5-44b8-a323-acdc2894c9cd tempest-CreateVolumesFromSnapshotTest-258924953 None] Created volume successfully. Sep 09 14:53:24 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 1073741824" returned: 0 in 0.485s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:24 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 Sep 09 14:53:24 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:25 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1" returned: 0 in 0.264s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185126925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fc1ed9-c814-412b-9ddf-eabd0c347696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3f165adf804db09ff4bc40f240de1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:23Z,use_quota=True,user_id='2977c48d378a40d7b81d47e1cab3fd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Creating volume 10fc1ed9-c814-412b-9ddf-eabd0c347696 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:25 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ad9f67-da7b-492c-a8f3-13d30946e92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9041d809-6248-457d-8acf-4fd1b69dda1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:25 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 1073741824 Sep 09 14:53:25 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 (4272ab06-c0ef-4095-b22a-b6b65f9964f1): created successfully Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9041d809-6248-457d-8acf-4fd1b69dda1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (200e705a-df41-43b0-861e-34f316529c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ca5f7c50-aabd-4bf9-8a6f-abe111de9e0c tempest-CreateVolumesFromSnapshotTest-258924953 None] Created volume successfully. Sep 09 14:53:25 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 1073741824" returned: 0 in 0.534s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:25 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 Sep 09 14:53:25 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:25 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82e9d00-0a40-4a2f-b9bb-40317564e386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fc1ed9-c814-412b-9ddf-eabd0c347696', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5b6780-fb4f-4a07-bc69-7e769aee187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Volume volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 (10fc1ed9-c814-412b-9ddf-eabd0c347696): created successfully Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5b6780-fb4f-4a07-bc69-7e769aee187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Flow 'volume_create_manager' (4d1409f1-83f2-4f1d-8f0f-1a9f062482be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5fea9076-d7f2-4a69-9bdc-50c07882b62d tempest-CreateVolumesFromSnapshotTest-258924953 None] Created volume successfully. Sep 09 14:53:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-10fc1ed9-c814-412b-9ddf-eabd0c347696-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-10fc1ed9-c814-412b-9ddf-eabd0c347696-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-10fc1ed9-c814-412b-9ddf-eabd0c347696" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-10fc1ed9-c814-412b-9ddf-eabd0c347696" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada311d-3e2d-4cc8-84c8-6f2081261242]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:26 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 Sep 09 14:53:26 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:27 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696" returned: 0 in 0.385s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:27 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696 Sep 09 14:53:27 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:27 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-10fc1ed9-c814-412b-9ddf-eabd0c347696" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-10fc1ed9-c814-412b-9ddf-eabd0c347696" released by "delete_volume" :: held 0.718s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['c7903a88-c3a6-4556-878d-ee7e91175bdf', '67a8799a-304f-4b4c-8e3a-83878b43cdee', 'e0c25466-ae30-4249-90fe-4c1342438998', '64224c96-f987-41b6-bb84-5af35b5d0cc3'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:27 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:27 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:27 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleted volume successfully. Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-4272ab06-c0ef-4095-b22a-b6b65f9964f1-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1af3902c-2df0-4585-ac9e-c877ec2ec3d6 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-10fc1ed9-c814-412b-9ddf-eabd0c347696-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-4272ab06-c0ef-4095-b22a-b6b65f9964f1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-4272ab06-c0ef-4095-b22a-b6b65f9964f1" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-4272ab06-c0ef-4095-b22a-b6b65f9964f1" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[23163785-2762-4b19-b32b-7216d2d67bc3]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:27 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 Sep 09 14:53:27 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:28 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1" returned: 0 in 0.424s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:28 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1 Sep 09 14:53:28 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:28 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4272ab06-c0ef-4095-b22a-b6b65f9964f1" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-4272ab06-c0ef-4095-b22a-b6b65f9964f1" released by "delete_volume" :: held 0.715s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['1e847fc6-1954-4137-b518-a1110b42e8a2', '8e821606-bcd9-4ebf-b0b1-6d4d88d228a9', '4f63bc64-a978-4b74-b481-28ac28b78992', 'b2dd6f6f-3bf9-4737-9015-013edcf0503e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:28 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:28 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-29239bae-7326-4123-97cb-90880ec9a4a2-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-29239bae-7326-4123-97cb-90880ec9a4a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:28 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:28 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleted volume successfully. Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-29239bae-7326-4123-97cb-90880ec9a4a2" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ae31e757-5e56-49ff-95c2-1450ae2f10fc tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-4272ab06-c0ef-4095-b22a-b6b65f9964f1-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-29239bae-7326-4123-97cb-90880ec9a4a2" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[91141f06-12dd-468d-9f94-cc735915785a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:29 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 Sep 09 14:53:29 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:29 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2" returned: 0 in 0.370s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:29 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2 Sep 09 14:53:29 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:29 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-29239bae-7326-4123-97cb-90880ec9a4a2" returned: 0 in 0.255s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-29239bae-7326-4123-97cb-90880ec9a4a2" released by "delete_volume" :: held 0.677s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['0151f4fc-7283-4aa5-a527-a0c37efade45', 'c28b32de-3827-450e-ba94-bc724c046372', '57b6e34d-18d9-441c-a2d0-0c7d906a3bea', 'c7fba1d9-f3e5-4b04-bdd9-6416329b6425'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:29 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:29 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:30 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-06daef93-d42f-4a95-adc2-e6efc758a821-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleted volume successfully. Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-06daef93-d42f-4a95-adc2-e6efc758a821-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-70185844-e45e-4232-a869-1bcdb74d94e3 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-29239bae-7326-4123-97cb-90880ec9a4a2-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-06daef93-d42f-4a95-adc2-e6efc758a821" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-06daef93-d42f-4a95-adc2-e6efc758a821" acquired by "delete_volume" :: waited 0.013s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9397522-038a-40c2-bbed-c53bd00a27dd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:30 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 Sep 09 14:53:30 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:30 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821" returned: 0 in 0.355s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:30 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821 Sep 09 14:53:30 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:30 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-06daef93-d42f-4a95-adc2-e6efc758a821" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-06daef93-d42f-4a95-adc2-e6efc758a821" released by "delete_volume" :: held 0.671s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:30 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['373899de-2202-4ef3-9b6a-da4a5459a113', 'e616f7b8-3c1c-4e06-b06c-594f62c08815', '56c6035b-779a-4ff8-b209-a01b2420ef39', 'e67d630f-0b5d-40ea-b9ae-cc4ad53b95b1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:31 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:31 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:31 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-fe0a783c-8104-4062-886e-f26035d6c8c4-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.281s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleted volume successfully. Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-fe0a783c-8104-4062-886e-f26035d6c8c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-be2b48de-ff8d-467d-86d8-184069375dd0 tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-06daef93-d42f-4a95-adc2-e6efc758a821-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-fe0a783c-8104-4062-886e-f26035d6c8c4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-fe0a783c-8104-4062-886e-f26035d6c8c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de83a03-f44b-417e-85e4-8c2a590da916]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:31 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 Sep 09 14:53:31 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:31 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:31 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4 Sep 09 14:53:31 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:32 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-fe0a783c-8104-4062-886e-f26035d6c8c4" returned: 0 in 0.310s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-fe0a783c-8104-4062-886e-f26035d6c8c4" released by "delete_volume" :: held 0.770s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['ab10d6fc-73e6-421b-b0fe-4904545a9beb', 'fdcdd724-3acc-48ce-b32b-d1fd60be3bec', '212b3317-68d4-43a8-ae32-cec02ed0ab28', '9a151ccf-6874-4e0b-bca1-8b11254b6436'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:32 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:32 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-80d1bdff-8321-4466-b138-32481e74581b-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-80d1bdff-8321-4466-b138-32481e74581b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-49670079-c78d-4a03-9a8b-d5c8e448faf3" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-49670079-c78d-4a03-9a8b-d5c8e448faf3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-80d1bdff-8321-4466-b138-32481e74581b" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-80d1bdff-8321-4466-b138-32481e74581b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleting offline snapshot 80d1bdff-8321-4466-b138-32481e74581b of volume 49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] snapshot_file for this snap is: volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c7392-7b47-4b20-ba46-490c3c1fb27e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:32 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.314s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleted volume successfully. Sep 09 14:53:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2e4d4e7f-320c-409f-ab8e-294173dee84a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-fe0a783c-8104-4062-886e-f26035d6c8c4-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:32 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b Sep 09 14:53:32 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:33 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b" returned: 0 in 0.410s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49670079-c78d-4a03-9a8b-d5c8e448faf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98ff82-0454-4030-897e-ffb668c67510]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:33 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 Sep 09 14:53:33 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:33 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3" returned: 0 in 0.380s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:33 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b Sep 09 14:53:33 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:33 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b" returned: 0 in 0.375s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:33 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b Sep 09 14:53:33 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:34 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3.80d1bdff-8321-4466-b138-32481e74581b" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-80d1bdff-8321-4466-b138-32481e74581b" released by "_delete_snapshot" :: held 1.541s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-49670079-c78d-4a03-9a8b-d5c8e448faf3" released by "delete_snapshot" :: held 1.564s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['e5251e68-33cf-4cd0-a349-16b1b271426c', '80dd85d4-55dd-4fba-ba44-9cbc15ed1d7a', '683fbf63-4bb6-4846-b93a-50112f79ba84', '1d649b7a-3ac5-48c7-b867-cbea9549f1e6'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Delete snapshot completed successfully. Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-cb6f2611-60f4-4ca5-8e0f-2479ac7cdc2a tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-80d1bdff-8321-4466-b138-32481e74581b-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-49670079-c78d-4a03-9a8b-d5c8e448faf3-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-49670079-c78d-4a03-9a8b-d5c8e448faf3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "cinder-quobyte-49670079-c78d-4a03-9a8b-d5c8e448faf3" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-49670079-c78d-4a03-9a8b-d5c8e448faf3" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fd428-1670-4e0c-8888-8c8048c830e7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:34 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 Sep 09 14:53:34 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:35 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:35 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3 Sep 09 14:53:35 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:35 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-49670079-c78d-4a03-9a8b-d5c8e448faf3" returned: 0 in 0.286s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-quobyte-49670079-c78d-4a03-9a8b-d5c8e448faf3" released by "delete_volume" :: held 0.775s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Created reservations ['eefe03d1-1a82-4038-80fe-38efa558e81e', 'e6dbf591-2dd7-40c2-9384-023cc76e1b26', 'e48fe310-95c7-4f6f-9138-80eb27fbf924', '36d76942-8d66-494b-8030-2742d2991f07'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:35 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:35 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:35 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:35 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Deleted volume successfully. Sep 09 14:53:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0fbcf3e4-4ee0-476f-94a6-ad750cb1743b tempest-CreateVolumesFromSnapshotTest-258924953 None] Lock "cinder-49670079-c78d-4a03-9a8b-d5c8e448faf3-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Flow 'volume_create_manager' (0d31f821-5060-4ffd-a25c-c677c2158949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b68850-59d2-47e9-a994-a384d560ce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b68850-59d2-47e9-a994-a384d560ce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-429476006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443d19d0-5f99-424e-919b-3a220b2ea8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3169f64f40a419da3130e91bb2326bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:39Z,use_quota=True,user_id='e289181791b645cfadbb550c0bd170f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ea149c-f075-41c6-a7d2-61e65c1e130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ea149c-f075-41c6-a7d2-61e65c1e130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d10219a-b4d3-419e-be1d-c5fe3d69962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d10219a-b4d3-419e-be1d-c5fe3d69962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443d19d0-5f99-424e-919b-3a220b2ea8b2', 'volume_name': 'volume-443d19d0-5f99-424e-919b-3a220b2ea8b2', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e810922e-9bfd-4663-8751-e85aa8b80d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e810922e-9bfd-4663-8751-e85aa8b80d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06778bc5-b54a-456b-a2bb-97d661cca7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:39 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Volume 443d19d0-5f99-424e-919b-3a220b2ea8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443d19d0-5f99-424e-919b-3a220b2ea8b2', 'volume_size': 1} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-429476006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443d19d0-5f99-424e-919b-3a220b2ea8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3169f64f40a419da3130e91bb2326bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:39Z,use_quota=True,user_id='e289181791b645cfadbb550c0bd170f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Creating volume 443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:39 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:39 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 1073741824 Sep 09 14:53:39 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:39 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 1073741824" returned: 0 in 0.533s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:39 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 Sep 09 14:53:39 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:40 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06778bc5-b54a-456b-a2bb-97d661cca7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443d19d0-5f99-424e-919b-3a220b2ea8b2', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7281532-2c96-4a3c-8920-cd59551b28ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Volume volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 (443d19d0-5f99-424e-919b-3a220b2ea8b2): created successfully Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7281532-2c96-4a3c-8920-cd59551b28ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Flow 'volume_create_manager' (0d31f821-5060-4ffd-a25c-c677c2158949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0f8b952a-91e2-4aae-8106-bf2371fb4a5e tempest-VolumeDependencyTests-859373710 None] Created volume successfully. Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Creating offline snapshot c13dad27-d55f-46af-9e78-0488d7e464dd of volume 443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e8ae2-d8f4-44d1-acbd-09756dfae235]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:41 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 Sep 09 14:53:41 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:41 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:41 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd 1G Sep 09 14:53:41 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:42 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd 1G" returned: 0 in 0.499s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:42 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd Sep 09 14:53:42 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:42 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd" returned: 0 in 0.403s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:42 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd is being set with open permissions: ugo+rw Sep 09 14:53:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:42 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd Sep 09 14:53:42 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:43 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd" returned: 0 in 0.300s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:43 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info Sep 09 14:53:43 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:43 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info" returned: 0 in 0.263s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:43 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info is being set with open permissions: ugo+rw Sep 09 14:53:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:43 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info Sep 09 14:53:43 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:43 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.info" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:43 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-25b7f7b5-fe72-4d94-bfb2-47b03c04d7a8 tempest-VolumeDependencyTests-859373710 None] Create snapshot completed successfully Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Flow 'volume_create_manager' (506e3ee9-3d06-4d56-b29f-72f09fe5ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afabbad7-f1a7-4b2c-a6be-b58cc7eff07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afabbad7-f1a7-4b2c-a6be-b58cc7eff07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1738976260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501087e5-e68f-431d-aff5-8bd805a4bfab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3169f64f40a419da3130e91bb2326bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c13dad27-d55f-46af-9e78-0488d7e464dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:53:45Z,use_quota=True,user_id='e289181791b645cfadbb550c0bd170f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f58136-6684-44e4-8ccb-602ec9acf853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f58136-6684-44e4-8ccb-602ec9acf853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032e344e-c1b6-4cc2-ac8a-f33cf708354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032e344e-c1b6-4cc2-ac8a-f33cf708354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '501087e5-e68f-431d-aff5-8bd805a4bfab', 'volume_name': 'volume-501087e5-e68f-431d-aff5-8bd805a4bfab', 'volume_size': 1, 'snapshot_id': 'c13dad27-d55f-46af-9e78-0488d7e464dd'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad85486-bb98-4895-98fe-8c6be8e7c698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad85486-bb98-4895-98fe-8c6be8e7c698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acefe98-c2c8-4c28-9689-75b8f5877c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:45 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Volume 501087e5-e68f-431d-aff5-8bd805a4bfab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-501087e5-e68f-431d-aff5-8bd805a4bfab', 'volume_size': 1, 'snapshot_id': 'c13dad27-d55f-46af-9e78-0488d7e464dd'} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-quobyte-c13dad27-d55f-46af-9e78-0488d7e464dd-501087e5-e68f-431d-aff5-8bd805a4bfab" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-c13dad27-d55f-46af-9e78-0488d7e464dd-501087e5-e68f-431d-aff5-8bd805a4bfab" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Creating volume 501087e5-e68f-431d-aff5-8bd805a4bfab from snapshot c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-quobyte-501087e5-e68f-431d-aff5-8bd805a4bfab" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-501087e5-e68f-431d-aff5-8bd805a4bfab" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] snapshot: c13dad27-d55f-46af-9e78-0488d7e464dd, volume: 501087e5-e68f-431d-aff5-8bd805a4bfab, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7bed5-ce95-4e18-9598-187bbb4c7a12]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:45 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd Sep 09 14:53:45 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:45 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443d19d0-5f99-424e-919b-3a220b2ea8b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ea322-6615-40c3-a0c2-95926a957cf3]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:45 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 Sep 09 14:53:45 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:46 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:53:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:53:46 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:53:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:46 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab Sep 09 14:53:46 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:50 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab" returned: 0 in 4.450s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:50 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:53:50 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Converted 1024.00 MB image at 230.05 MB/s Sep 09 14:53:50 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab is being set with open permissions: ugo+rw Sep 09 14:53:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:50 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab Sep 09 14:53:50 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:50 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab" returned: 0 in 0.330s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-501087e5-e68f-431d-aff5-8bd805a4bfab" released by "_copy_volume_from_snapshot" :: held 5.652s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-c13dad27-d55f-46af-9e78-0488d7e464dd-501087e5-e68f-431d-aff5-8bd805a4bfab" released by "_create_volume_from_snapshot" :: held 5.722s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.738s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acefe98-c2c8-4c28-9689-75b8f5877c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501087e5-e68f-431d-aff5-8bd805a4bfab', 'volume_size': 1, 'snapshot_id': 'c13dad27-d55f-46af-9e78-0488d7e464dd'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5247f6ba-ed3b-4166-9b67-b1f7cad51f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:53:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Volume volume-501087e5-e68f-431d-aff5-8bd805a4bfab (501087e5-e68f-431d-aff5-8bd805a4bfab): created successfully Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5247f6ba-ed3b-4166-9b67-b1f7cad51f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Flow 'volume_create_manager' (506e3ee9-3d06-4d56-b29f-72f09fe5ab83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:53:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d5ef782c-a114-44ea-b7f9-fc680378bab6 tempest-VolumeDependencyTests-859373710 None] Created volume successfully. Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-c13dad27-d55f-46af-9e78-0488d7e464dd-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-c13dad27-d55f-46af-9e78-0488d7e464dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-quobyte-443d19d0-5f99-424e-919b-3a220b2ea8b2" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-443d19d0-5f99-424e-919b-3a220b2ea8b2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-quobyte-c13dad27-d55f-46af-9e78-0488d7e464dd" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-c13dad27-d55f-46af-9e78-0488d7e464dd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Deleting offline snapshot c13dad27-d55f-46af-9e78-0488d7e464dd of volume 443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] snapshot_file for this snap is: volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f6869-b5b7-4709-b637-266dd85777f8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:52 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd Sep 09 14:53:52 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:52 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:52 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:52 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd" returned: 0 in 0.431s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-443d19d0-5f99-424e-919b-3a220b2ea8b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c28a64f-d396-4f60-b3ef-e703b3d0ed76]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:52 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 Sep 09 14:53:52 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:52 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:53:52 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2" returned: 0 in 0.610s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:53 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd Sep 09 14:53:53 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:53 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd" returned: 0 in 0.395s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:53 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd Sep 09 14:53:53 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:53 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2.c13dad27-d55f-46af-9e78-0488d7e464dd" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=132,cinder:SELECT=115,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=112,cinder:INSERT=33,cinder:UPDATE=136,cinder:DELETE=12 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-c13dad27-d55f-46af-9e78-0488d7e464dd" released by "_delete_snapshot" :: held 1.848s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-443d19d0-5f99-424e-919b-3a220b2ea8b2" released by "delete_snapshot" :: held 1.878s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Created reservations ['4163f511-dfcb-41b8-b445-d32baed4d3e6', 'b08f2b70-51f6-46b0-b628-ac85aaf52eeb', '6f873b40-f7bb-44e3-8a0f-2a9b1c18d1ec', '4b19577e-9f8e-4d0c-9597-a6c81a84ab59'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Delete snapshot completed successfully. Sep 09 14:53:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0ed40e37-813e-4282-b6d0-76d402bfa701 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-c13dad27-d55f-46af-9e78-0488d7e464dd-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-443d19d0-5f99-424e-919b-3a220b2ea8b2-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Lock "cinder-443d19d0-5f99-424e-919b-3a220b2ea8b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-quobyte-443d19d0-5f99-424e-919b-3a220b2ea8b2" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-443d19d0-5f99-424e-919b-3a220b2ea8b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[343743b6-4ab8-4439-80f3-d781cc3b0d2f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:54 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 Sep 09 14:53:54 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:54 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:54 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2 Sep 09 14:53:54 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:54 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-443d19d0-5f99-424e-919b-3a220b2ea8b2" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-443d19d0-5f99-424e-919b-3a220b2ea8b2" released by "delete_volume" :: held 0.770s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Created reservations ['fee7023d-beae-45d1-9f91-2fb0157470db', '88166f15-45a7-4e34-a11a-9da98c0bbac8', 'e7b43ccf-8e63-4639-8a72-a812c53b7dc4', 'f6fcef4b-434f-4aaf-8183-bf0e7efda9c0'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:55 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:55 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-501087e5-e68f-431d-aff5-8bd805a4bfab-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-501087e5-e68f-431d-aff5-8bd805a4bfab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "cinder-quobyte-501087e5-e68f-431d-aff5-8bd805a4bfab" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-501087e5-e68f-431d-aff5-8bd805a4bfab" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:53:55 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.369s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Deleted volume successfully. Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a87726-5c53-49fb-ae31-efc46a6fca17]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-274e7fc2-3668-43ba-8f51-34162aeeefba tempest-VolumeDependencyTests-859373710 None] Lock "cinder-443d19d0-5f99-424e-919b-3a220b2ea8b2-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:55 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab Sep 09 14:53:55 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:55 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab" returned: 0 in 0.452s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:55 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab Sep 09 14:53:55 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:56 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-501087e5-e68f-431d-aff5-8bd805a4bfab" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-quobyte-501087e5-e68f-431d-aff5-8bd805a4bfab" released by "delete_volume" :: held 0.776s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Created reservations ['af7698b4-0cd9-4323-b37c-df57ac1daa1b', '0760cc90-e272-4d5c-873c-c29a4a7f340a', '5d63cb7f-b63b-4bfe-8bd7-a8c6acf3b1cc', 'd6a5e6e8-17b4-4ac6-bd00-d3813cf07bdb'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:53:56 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:53:56 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:53:56 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.271s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:53:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Deleted volume successfully. Sep 09 14:53:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0bb80ad6-8671-4c9e-811d-e4395d7ce152 tempest-VolumeDependencyTests-859373710 None] Lock "cinder-501087e5-e68f-431d-aff5-8bd805a4bfab-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=19 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=12,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Flow 'volume_create_manager' (1744152d-02cb-40e1-85b8-8245efd27b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9662c217-0fdc-4df4-a63e-af918080ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9662c217-0fdc-4df4-a63e-af918080ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2139896059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a79438-8ed1-4bce-bfc5-89d65d4ba9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199ed56e16a142a1832ec335fcc82fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:54:07Z,use_quota=True,user_id='8f83bb5901af49beadebdef6ab5cc28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4fa941-9580-42ec-817a-7bc4a273f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4fa941-9580-42ec-817a-7bc4a273f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4a8c31-e59f-4994-9328-b9383c51a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4a8c31-e59f-4994-9328-b9383c51a504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a79438-8ed1-4bce-bfc5-89d65d4ba9f8', 'volume_name': 'volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac06a947-32ba-499d-8f24-753abb7bedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac06a947-32ba-499d-8f24-753abb7bedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adb5ccf-e4b0-4276-bb04-dc4a46802a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:54:06 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Volume 38a79438-8ed1-4bce-bfc5-89d65d4ba9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8', 'volume_size': 1} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2139896059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a79438-8ed1-4bce-bfc5-89d65d4ba9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199ed56e16a142a1832ec335fcc82fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:54:07Z,use_quota=True,user_id='8f83bb5901af49beadebdef6ab5cc28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Creating volume 38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:54:06 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:54:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:54:06 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 1073741824 Sep 09 14:54:06 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:54:07 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 1073741824" returned: 0 in 0.433s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:54:07 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 Sep 09 14:54:07 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:54:07 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8" returned: 0 in 0.246s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adb5ccf-e4b0-4276-bb04-dc4a46802a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c09c3f-bea9-4ea9-9d5e-942011752ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:54:07 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Volume volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 (38a79438-8ed1-4bce-bfc5-89d65d4ba9f8): created successfully Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c09c3f-bea9-4ea9-9d5e-942011752ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:54:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Flow 'volume_create_manager' (1744152d-02cb-40e1-85b8-8245efd27b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:54:07 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8500bb6a-0d81-4ca8-8a7c-caa41f022148 tempest-TestMinimumBasicScenario-581896106 None] Created volume successfully. Sep 09 14:54:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8a78fae8-9723-496a-a7de-c662b4bae0e1 req-99acd8cb-0b44-447a-a57c-de7125de19cb tempest-TestMinimumBasicScenario-581896106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:54:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8a78fae8-9723-496a-a7de-c662b4bae0e1 req-99acd8cb-0b44-447a-a57c-de7125de19cb tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:54:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8a78fae8-9723-496a-a7de-c662b4bae0e1 req-99acd8cb-0b44-447a-a57c-de7125de19cb tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:54:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-8a78fae8-9723-496a-a7de-c662b4bae0e1 req-99acd8cb-0b44-447a-a57c-de7125de19cb tempest-TestMinimumBasicScenario-581896106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e00dbbb-c79f-4828-aaa3-a9ba621f2921', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:54:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-8a78fae8-9723-496a-a7de-c662b4bae0e1 req-99acd8cb-0b44-447a-a57c-de7125de19cb tempest-TestMinimumBasicScenario-581896106 None] attachment_update completed successfully. Sep 09 14:54:18 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:54:18 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:54:52 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:54:52 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:54:52 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:54:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:54:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-faf50c7c-81a7-4acf-b941-2e83fc99b7e1 req-99145f7f-d4d6-442d-a75a-2e84eb150af1 tempest-TestMinimumBasicScenario-581896106 None] Terminate volume connection completed successfully. Sep 09 14:54:55 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-faf50c7c-81a7-4acf-b941-2e83fc99b7e1 req-99145f7f-d4d6-442d-a75a-2e84eb150af1 tempest-TestMinimumBasicScenario-581896106 None] Deleting attachment 1e00dbbb-c79f-4828-aaa3-a9ba621f2921. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Acquiring lock "cinder-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Lock "cinder-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Acquiring lock "cinder-quobyte-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Lock "cinder-quobyte-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a529c4-17f0-4d09-9575-944f49bdfda5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:54:56 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 Sep 09 14:54:56 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:54:56 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8" returned: 0 in 0.362s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:54:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:54:56 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8 Sep 09 14:54:56 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:54:57 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8" returned: 0 in 0.238s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Lock "cinder-quobyte-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8" released by "delete_volume" :: held 0.640s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Created reservations ['c1c370f4-e06b-4f66-aaf1-d867733acace', 'ff5d6b8c-5828-42e5-ac6e-4b2d3a7782f8', 'd157420e-8b59-4a89-ad94-9a2bb0220621', '1f16c6ed-bf68-4b06-9597-76e9241a510f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:54:57 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:54:57 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:54:57 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.239s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:54:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Deleted volume successfully. Sep 09 14:54:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-fa2a0544-4e8b-44eb-9237-246506485d3e tempest-TestMinimumBasicScenario-581896106 None] Lock "cinder-38a79438-8ed1-4bce-bfc5-89d65d4ba9f8-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:55:07 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:55:07 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:55:35 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:55:35 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:55:52 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:55:52 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:55:52 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.262s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:55:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Flow 'volume_create_manager' (75ef542c-beb8-453c-9ec1-32dccc2a83d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a71e1b0-95f2-4fcc-ae5b-f66e303fb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a71e1b0-95f2-4fcc-ae5b-f66e303fb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-124652749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3a1b9a-56c1-4667-a241-b57e85753a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0fac542949c45ffbcc6c957d38ab6e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:56:02Z,use_quota=True,user_id='5642ad9b129a4578943d18f343ff7e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e436d5d3-26f6-4aa5-b086-bc2d86caba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e436d5d3-26f6-4aa5-b086-bc2d86caba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc420898-5436-4ef0-a663-3ac03a88d3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc420898-5436-4ef0-a663-3ac03a88d3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3a1b9a-56c1-4667-a241-b57e85753a41', 'volume_name': 'volume-2e3a1b9a-56c1-4667-a241-b57e85753a41', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521d6f0e-2cd1-4d05-a563-2295d1a277e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521d6f0e-2cd1-4d05-a563-2295d1a277e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae33cb76-76d2-4df6-8cc2-fc88154c088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:02 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Volume 2e3a1b9a-56c1-4667-a241-b57e85753a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3a1b9a-56c1-4667-a241-b57e85753a41', 'volume_size': 1} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-124652749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3a1b9a-56c1-4667-a241-b57e85753a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0fac542949c45ffbcc6c957d38ab6e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:56:02Z,use_quota=True,user_id='5642ad9b129a4578943d18f343ff7e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Creating volume 2e3a1b9a-56c1-4667-a241-b57e85753a41 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:56:02 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:02 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 1073741824 Sep 09 14:56:02 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:02 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 1073741824" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:02 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 Sep 09 14:56:02 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:03 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae33cb76-76d2-4df6-8cc2-fc88154c088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3a1b9a-56c1-4667-a241-b57e85753a41', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45868b7-562b-41c3-a03d-30c67f270ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:03 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Volume volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 (2e3a1b9a-56c1-4667-a241-b57e85753a41): created successfully Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45868b7-562b-41c3-a03d-30c67f270ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Flow 'volume_create_manager' (75ef542c-beb8-453c-9ec1-32dccc2a83d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:56:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f73b712d-5518-4444-a937-80829687081f tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Created volume successfully. Sep 09 14:56:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8f626c08-e638-49fe-8621-c9ff5f88c29c req-2903de0a-49c3-4fb7-9d66-7e3eb51ce1cd tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8f626c08-e638-49fe-8621-c9ff5f88c29c req-2903de0a-49c3-4fb7-9d66-7e3eb51ce1cd tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-8f626c08-e638-49fe-8621-c9ff5f88c29c req-2903de0a-49c3-4fb7-9d66-7e3eb51ce1cd tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:04 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-8f626c08-e638-49fe-8621-c9ff5f88c29c req-2903de0a-49c3-4fb7-9d66-7e3eb51ce1cd tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-2e3a1b9a-56c1-4667-a241-b57e85753a41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7483a926-abbf-4be8-b880-5f92f894a13e', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:56:04 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-8f626c08-e638-49fe-8621-c9ff5f88c29c req-2903de0a-49c3-4fb7-9d66-7e3eb51ce1cd tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] attachment_update completed successfully. Sep 09 14:56:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-59e8874e-35b0-4c34-9eca-a4f937d0ec32 req-aa069f1f-6700-4452-8b53-b1a7bcdac25d tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Terminate volume connection completed successfully. Sep 09 14:56:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-59e8874e-35b0-4c34-9eca-a4f937d0ec32 req-aa069f1f-6700-4452-8b53-b1a7bcdac25d tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Deleting attachment 7483a926-abbf-4be8-b880-5f92f894a13e. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Acquiring lock "cinder-2e3a1b9a-56c1-4667-a241-b57e85753a41-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "cinder-2e3a1b9a-56c1-4667-a241-b57e85753a41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Acquiring lock "cinder-quobyte-2e3a1b9a-56c1-4667-a241-b57e85753a41" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "cinder-quobyte-2e3a1b9a-56c1-4667-a241-b57e85753a41" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eb1829-9d5b-40b3-adbb-e63f08380d87]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:07 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 Sep 09 14:56:07 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:07 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41" returned: 0 in 0.358s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:07 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41 Sep 09 14:56:07 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:08 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2e3a1b9a-56c1-4667-a241-b57e85753a41" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "cinder-quobyte-2e3a1b9a-56c1-4667-a241-b57e85753a41" released by "delete_volume" :: held 0.648s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Created reservations ['e151b056-dfcb-404f-add4-79aa4b95c257', '6295fdf2-5101-4b63-8466-79f01d21d65a', '76a92464-7606-4064-93b6-1e0e40e12c8f', 'cc1835b2-75d4-4f3c-bb73-7cabe65e71b3'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:08 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:56:08 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:08 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:56:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Deleted volume successfully. Sep 09 14:56:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-14da2754-fd52-4a1d-9beb-7ae6f5067c0c tempest-TestServerVolumeAttachScenarioOldVersion-339825881 None] Lock "cinder-2e3a1b9a-56c1-4667-a241-b57e85753a41-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:56:18 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:56:18 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Flow 'volume_create_manager' (fd8c5585-a45e-4e05-abc0-e4034de8a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b8d31b-117c-49d7-b96e-a5d01030510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b8d31b-117c-49d7-b96e-a5d01030510c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1617456292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2915c9-e80d-4c8f-b4e4-aa8b96282d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0deaa6a8fdbb4e8497ff6cd5b285520b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:56:42Z,use_quota=True,user_id='363c6f6ccc0c49b6932cc4118e5e4936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510f2034-ad46-4bb3-baad-838e69f6b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510f2034-ad46-4bb3-baad-838e69f6b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02175b69-ae9d-41f8-bfda-1309f38a8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02175b69-ae9d-41f8-bfda-1309f38a8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2915c9-e80d-4c8f-b4e4-aa8b96282d39', 'volume_name': 'volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a2d4f9-d2e5-45e2-a798-fe0e42ca8e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a2d4f9-d2e5-45e2-a798-fe0e42ca8e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3783603-94b1-41ce-8ce6-574dde18565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Volume 6c2915c9-e80d-4c8f-b4e4-aa8b96282d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39', 'volume_size': 1} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1617456292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2915c9-e80d-4c8f-b4e4-aa8b96282d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0deaa6a8fdbb4e8497ff6cd5b285520b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:56:42Z,use_quota=True,user_id='363c6f6ccc0c49b6932cc4118e5e4936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Creating volume 6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:56:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:42 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 1073741824 Sep 09 14:56:42 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Flow 'volume_create_manager' (36a32142-9e4a-45de-ba58-84e3035c8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361d10ca-4fdc-4480-8ac4-e0269142da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361d10ca-4fdc-4480-8ac4-e0269142da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1345123935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db650616-50e1-4591-a776-9bfcedd596e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0deaa6a8fdbb4e8497ff6cd5b285520b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:56:43Z,use_quota=True,user_id='363c6f6ccc0c49b6932cc4118e5e4936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7288526e-8189-4278-866d-e65d41103df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7288526e-8189-4278-866d-e65d41103df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb09fa2-9682-4624-a512-fb8661524d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb09fa2-9682-4624-a512-fb8661524d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db650616-50e1-4591-a776-9bfcedd596e4', 'volume_name': 'volume-db650616-50e1-4591-a776-9bfcedd596e4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bfb05a-2439-471b-9cbc-de395613a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bfb05a-2439-471b-9cbc-de395613a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58ef833-6448-4b9b-bd82-732e72942d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Volume db650616-50e1-4591-a776-9bfcedd596e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db650616-50e1-4591-a776-9bfcedd596e4', 'volume_size': 1} Sep 09 14:56:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:43 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 1073741824" returned: 0 in 0.521s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:43 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 Sep 09 14:56:43 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:43 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39" returned: 0 in 0.263s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1345123935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db650616-50e1-4591-a776-9bfcedd596e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0deaa6a8fdbb4e8497ff6cd5b285520b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:56:43Z,use_quota=True,user_id='363c6f6ccc0c49b6932cc4118e5e4936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Creating volume db650616-50e1-4591-a776-9bfcedd596e4 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:56:43 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3783603-94b1-41ce-8ce6-574dde18565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:43 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 1073741824 Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad041c3-b192-4da8-a078-fa06f05d3e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:43 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Volume volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 (6c2915c9-e80d-4c8f-b4e4-aa8b96282d39): created successfully Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad041c3-b192-4da8-a078-fa06f05d3e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Flow 'volume_create_manager' (fd8c5585-a45e-4e05-abc0-e4034de8a74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:56:43 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6e748911-2a4f-4c57-a1b3-76a78751d188 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Created volume successfully. Sep 09 14:56:43 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 1073741824" returned: 0 in 0.478s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:43 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 Sep 09 14:56:43 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:44 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4" returned: 0 in 0.256s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58ef833-6448-4b9b-bd82-732e72942d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db650616-50e1-4591-a776-9bfcedd596e4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ada7b6-9420-4639-b67e-97498d009393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:56:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Volume volume-db650616-50e1-4591-a776-9bfcedd596e4 (db650616-50e1-4591-a776-9bfcedd596e4): created successfully Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ada7b6-9420-4639-b67e-97498d009393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:56:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Flow 'volume_create_manager' (36a32142-9e4a-45de-ba58-84e3035c8f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:56:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2c6261ac-0619-46aa-914f-f1ce811f9c3d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Created volume successfully. Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:56:52 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:56:52 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:56:52 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:56:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:56:54 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:56:54 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:57:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-af0950eb-f3bf-406d-a354-36614bc2d563 req-b8ec2b2e-44e5-4962-8e1e-937a5f0c159f tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-af0950eb-f3bf-406d-a354-36614bc2d563 req-b8ec2b2e-44e5-4962-8e1e-937a5f0c159f tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-af0950eb-f3bf-406d-a354-36614bc2d563 req-b8ec2b2e-44e5-4962-8e1e-937a5f0c159f tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:13 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-af0950eb-f3bf-406d-a354-36614bc2d563 req-b8ec2b2e-44e5-4962-8e1e-937a5f0c159f tempest-TestServerVolumeAttachmentScenario-1804733943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '987df355-7e1e-45af-9f47-aed30fd4faa2', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:57:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-af0950eb-f3bf-406d-a354-36614bc2d563 req-b8ec2b2e-44e5-4962-8e1e-937a5f0c159f tempest-TestServerVolumeAttachmentScenario-1804733943 None] attachment_update completed successfully. Sep 09 14:57:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-4a1a8980-ba96-4698-bb48-4e75c7736ee6 req-7b4e491d-7edf-498a-8060-181eecfd2980 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-4a1a8980-ba96-4698-bb48-4e75c7736ee6 req-7b4e491d-7edf-498a-8060-181eecfd2980 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [req-4a1a8980-ba96-4698-bb48-4e75c7736ee6 req-7b4e491d-7edf-498a-8060-181eecfd2980 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-4a1a8980-ba96-4698-bb48-4e75c7736ee6 req-7b4e491d-7edf-498a-8060-181eecfd2980 tempest-TestServerVolumeAttachmentScenario-1804733943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31', 'name': 'volume-db650616-50e1-4591-a776-9bfcedd596e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b1f9573-ffc4-4ab1-90e1-bcf3365a820c', 'enforce_multipath': True} {{(pid=87325) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 14:57:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-4a1a8980-ba96-4698-bb48-4e75c7736ee6 req-7b4e491d-7edf-498a-8060-181eecfd2980 tempest-TestServerVolumeAttachmentScenario-1804733943 None] attachment_update completed successfully. Sep 09 14:57:18 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-27e33022-5faf-494f-adaf-fbc27722dc94 req-15a5e797-496c-4b96-8869-d873a6781b7d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Terminate volume connection completed successfully. Sep 09 14:57:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-27e33022-5faf-494f-adaf-fbc27722dc94 req-15a5e797-496c-4b96-8869-d873a6781b7d tempest-TestServerVolumeAttachmentScenario-1804733943 None] Deleting attachment 5b1f9573-ffc4-4ab1-90e1-bcf3365a820c. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:57:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [req-fea50fe5-e250-43e0-9547-0e348c8a63eb req-24c3706f-7cdf-42c1-b7ae-b28a0fd2d56e tempest-TestServerVolumeAttachmentScenario-1804733943 None] Terminate volume connection completed successfully. Sep 09 14:57:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [req-fea50fe5-e250-43e0-9547-0e348c8a63eb req-24c3706f-7cdf-42c1-b7ae-b28a0fd2d56e tempest-TestServerVolumeAttachmentScenario-1804733943 None] Deleting attachment 987df355-7e1e-45af-9f47-aed30fd4faa2. {{(pid=87325) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 14:57:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "cinder-db650616-50e1-4591-a776-9bfcedd596e4-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-db650616-50e1-4591-a776-9bfcedd596e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "cinder-quobyte-db650616-50e1-4591-a776-9bfcedd596e4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-quobyte-db650616-50e1-4591-a776-9bfcedd596e4" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e332372-69bf-4507-9dbd-e20e3105e0c9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:26 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 Sep 09 14:57:26 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:26 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:26 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4 Sep 09 14:57:26 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:26 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-db650616-50e1-4591-a776-9bfcedd596e4" returned: 0 in 0.241s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-quobyte-db650616-50e1-4591-a776-9bfcedd596e4" released by "delete_volume" :: held 0.652s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Created reservations ['77366e1a-0180-45c5-ac08-910a1fe6cffd', 'e12e0dd1-9d2e-487a-a58b-783680239038', '77b99c46-df29-4af0-8d05-74101f584b15', 'fedbac94-af5f-40e4-b60f-0ea08295a5a9'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:26 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:26 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:26 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.243s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Deleted volume successfully. Sep 09 14:57:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-415adb9c-4084-4ff2-a5ea-5d39db69f1bc tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-db650616-50e1-4591-a776-9bfcedd596e4-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "cinder-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "cinder-quobyte-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-quobyte-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c7ed0d-d7b4-444e-a1b5-7733cb09bb27]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:27 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 Sep 09 14:57:27 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:27 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39" returned: 0 in 0.342s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:27 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39 Sep 09 14:57:27 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:27 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39" returned: 0 in 0.239s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-quobyte-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39" released by "delete_volume" :: held 0.619s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Created reservations ['b0dec803-0580-4990-aa8f-ae1a5f79e70f', '3a89a805-ee15-4393-83c4-a9a2f5d8744c', 'b3218e9d-76f7-4fc3-af00-a80d3aff7159', '50f64d74-2418-4496-a515-ad2ceb812360'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:27 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:27 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:28 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.237s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:28 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Deleted volume successfully. Sep 09 14:57:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d70ee8d1-540b-4d02-8ca9-bfb916d567ae tempest-TestServerVolumeAttachmentScenario-1804733943 None] Lock "cinder-6c2915c9-e80d-4c8f-b4e4-aa8b96282d39-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:37 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=25,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:57:38 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (e4c0f931-bf5a-466f-8623-5de52b70c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0669c74d-ff24-44fb-b4ec-8846ab1be24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0669c74d-ff24-44fb-b4ec-8846ab1be24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277304700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030775c0-4cac-48c7-96ef-6c8c98fbda02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:39Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c2c859-2d02-4181-8c7b-a2455f375cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c2c859-2d02-4181-8c7b-a2455f375cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0f883d-38e8-489d-96ba-1a46b6fac7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0f883d-38e8-489d-96ba-1a46b6fac7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030775c0-4cac-48c7-96ef-6c8c98fbda02', 'volume_name': 'volume-030775c0-4cac-48c7-96ef-6c8c98fbda02', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32855d07-7daa-435f-a9ae-5b2c038b8fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32855d07-7daa-435f-a9ae-5b2c038b8fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97da172b-03f1-435e-beec-fcdb679e89ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Volume 030775c0-4cac-48c7-96ef-6c8c98fbda02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030775c0-4cac-48c7-96ef-6c8c98fbda02', 'volume_size': 1} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277304700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030775c0-4cac-48c7-96ef-6c8c98fbda02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:39Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Creating volume 030775c0-4cac-48c7-96ef-6c8c98fbda02 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:39 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:39 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 1073741824 Sep 09 14:57:39 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (eb513714-8d1c-4d17-a5c3-e5f553e37814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28966c-cfc7-407d-8d41-2600f259fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28966c-cfc7-407d-8d41-2600f259fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2058903842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c95778-723c-4033-aab1-0daf968f2833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:40Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a21cf03-f9e9-40b9-99c7-bca62b6bf5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a21cf03-f9e9-40b9-99c7-bca62b6bf5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2caffe-0240-451a-9fe2-4581af70d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2caffe-0240-451a-9fe2-4581af70d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c95778-723c-4033-aab1-0daf968f2833', 'volume_name': 'volume-95c95778-723c-4033-aab1-0daf968f2833', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aee8a9-7fac-4466-96d7-56ece2ed105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aee8a9-7fac-4466-96d7-56ece2ed105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f5e8fc-491b-446d-8754-38344e12d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:39 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Volume 95c95778-723c-4033-aab1-0daf968f2833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c95778-723c-4033-aab1-0daf968f2833', 'volume_size': 1} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:39 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 1073741824" returned: 0 in 0.487s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:39 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 Sep 09 14:57:39 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (de941c15-7c82-4ed9-acef-34cc1c4b6ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537ebff-4815-4539-bd39-a5d56d0f5120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9537ebff-4815-4539-bd39-a5d56d0f5120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057111970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a886fde4-3af1-4a5c-9dc8-95cb8827e2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:40Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709172b9-289d-4fd3-bb7a-3ac2747170f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709172b9-289d-4fd3-bb7a-3ac2747170f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0137db1-7a01-4997-8d9b-32f732884b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0137db1-7a01-4997-8d9b-32f732884b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a886fde4-3af1-4a5c-9dc8-95cb8827e2be', 'volume_name': 'volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c590adca-5790-494e-9dba-889bb649df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c590adca-5790-494e-9dba-889bb649df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07aadfbd-2e5a-4976-a0e4-9656320a43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Volume a886fde4-3af1-4a5c-9dc8-95cb8827e2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be', 'volume_size': 1} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:40 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02" returned: 0 in 0.294s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2058903842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c95778-723c-4033-aab1-0daf968f2833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:40Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Creating volume 95c95778-723c-4033-aab1-0daf968f2833 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:40 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97da172b-03f1-435e-beec-fcdb679e89ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030775c0-4cac-48c7-96ef-6c8c98fbda02', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a1a19e-95da-498e-889e-9ff40359287b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 1073741824 Sep 09 14:57:40 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Volume volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 (030775c0-4cac-48c7-96ef-6c8c98fbda02): created successfully Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a1a19e-95da-498e-889e-9ff40359287b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (e4c0f931-bf5a-466f-8623-5de52b70c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8a7bf9ab-44f6-4312-bffb-90ce869b7001 tempest-CreateVolumesFromImageTest-809676517 None] Created volume successfully. Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (e14ef974-771a-4ad0-9bf7-4254f097cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12e3765-4821-44d0-8f72-9faaf55c4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12e3765-4821-44d0-8f72-9faaf55c4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1999781691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71050657-099d-4b08-a2f8-8fa0bf6efef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:40Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dc27a1-0355-4fe2-aeca-9f1bdcf891d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dc27a1-0355-4fe2-aeca-9f1bdcf891d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35bd37b-f3e3-4016-85db-8f07efdd3a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35bd37b-f3e3-4016-85db-8f07efdd3a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71050657-099d-4b08-a2f8-8fa0bf6efef4', 'volume_name': 'volume-71050657-099d-4b08-a2f8-8fa0bf6efef4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea837de6-d412-4dce-a5ea-380ae6eab466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea837de6-d412-4dce-a5ea-380ae6eab466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12760950-8b03-4ce6-945a-0239a132d5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Volume 71050657-099d-4b08-a2f8-8fa0bf6efef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71050657-099d-4b08-a2f8-8fa0bf6efef4', 'volume_size': 1} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:40 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 1073741824" returned: 0 in 0.484s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:40 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 Sep 09 14:57:40 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (5a456b9d-8dc7-43d6-ac4c-10f00cd57bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87900ddd-af3d-41de-8a26-e552ec3e5c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87900ddd-af3d-41de-8a26-e552ec3e5c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-442695013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155d11ad-122f-46b6-adb8-f6052b3f5571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:41Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7157b459-1ae7-4caf-8963-b495211cd1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7157b459-1ae7-4caf-8963-b495211cd1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329c046c-e223-4550-bec9-a41ee8db232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329c046c-e223-4550-bec9-a41ee8db232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155d11ad-122f-46b6-adb8-f6052b3f5571', 'volume_name': 'volume-155d11ad-122f-46b6-adb8-f6052b3f5571', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f4f60c-5735-4afc-8a1f-4ecf71655510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f4f60c-5735-4afc-8a1f-4ecf71655510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ea228d-d389-43df-a568-99e49564a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Volume 155d11ad-122f-46b6-adb8-f6052b3f5571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155d11ad-122f-46b6-adb8-f6052b3f5571', 'volume_size': 1} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:40 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057111970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a886fde4-3af1-4a5c-9dc8-95cb8827e2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:40Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Creating volume a886fde4-3af1-4a5c-9dc8-95cb8827e2be {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:41 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f5e8fc-491b-446d-8754-38344e12d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c95778-723c-4033-aab1-0daf968f2833', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f938f3ca-e12e-435b-946b-f9dfc4aa9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:41 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be 1073741824 Sep 09 14:57:41 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:41 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Volume volume-95c95778-723c-4033-aab1-0daf968f2833 (95c95778-723c-4033-aab1-0daf968f2833): created successfully Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f938f3ca-e12e-435b-946b-f9dfc4aa9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (eb513714-8d1c-4d17-a5c3-e5f553e37814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-70bea169-7cfd-42fd-8b0c-c5236fa14e9b tempest-CreateVolumesFromImageTest-809676517 None] Created volume successfully. Sep 09 14:57:41 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be 1073741824" returned: 0 in 0.414s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:41 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be Sep 09 14:57:41 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:41 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be" returned: 0 in 0.237s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.183s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1999781691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71050657-099d-4b08-a2f8-8fa0bf6efef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:40Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Creating volume 71050657-099d-4b08-a2f8-8fa0bf6efef4 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:41 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07aadfbd-2e5a-4976-a0e4-9656320a43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:41 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 1073741824 Sep 09 14:57:41 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0062b9-0550-4427-89fb-118c12edb6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:41 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Volume volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be (a886fde4-3af1-4a5c-9dc8-95cb8827e2be): created successfully Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0062b9-0550-4427-89fb-118c12edb6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (de941c15-7c82-4ed9-acef-34cc1c4b6ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5cbcf5ed-6e25-40a2-865c-425ced506553 tempest-CreateVolumesFromImageTest-809676517 None] Created volume successfully. Sep 09 14:57:42 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 1073741824" returned: 0 in 0.434s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:42 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 Sep 09 14:57:42 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:42 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4" returned: 0 in 0.234s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-442695013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155d11ad-122f-46b6-adb8-f6052b3f5571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7d4b483cc846e681cc0c344f7f637e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:41Z,use_quota=True,user_id='876acadf6f0e4ba2af9ce5453f53642b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Creating volume 155d11ad-122f-46b6-adb8-f6052b3f5571 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12760950-8b03-4ce6-945a-0239a132d5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71050657-099d-4b08-a2f8-8fa0bf6efef4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9397b7d-4359-4a5d-9560-a53c6c3ba9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:42 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 1073741824 Sep 09 14:57:42 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Volume volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 (71050657-099d-4b08-a2f8-8fa0bf6efef4): created successfully Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9397b7d-4359-4a5d-9560-a53c6c3ba9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (e14ef974-771a-4ad0-9bf7-4254f097cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-67bba2ff-d642-4c58-beed-89dd85f402d5 tempest-CreateVolumesFromImageTest-809676517 None] Created volume successfully. Sep 09 14:57:42 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 1073741824" returned: 0 in 0.398s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:42 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 Sep 09 14:57:42 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:43 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571" returned: 0 in 0.248s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ea228d-d389-43df-a568-99e49564a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155d11ad-122f-46b6-adb8-f6052b3f5571', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67727e7a-74c2-4380-900d-2e93311b2e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Volume volume-155d11ad-122f-46b6-adb8-f6052b3f5571 (155d11ad-122f-46b6-adb8-f6052b3f5571): created successfully Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67727e7a-74c2-4380-900d-2e93311b2e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Flow 'volume_create_manager' (5a456b9d-8dc7-43d6-ac4c-10f00cd57bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:43 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-fdbb76e8-381c-459b-be13-83b8373332a6 tempest-CreateVolumesFromImageTest-809676517 None] Created volume successfully. Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-155d11ad-122f-46b6-adb8-f6052b3f5571-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-155d11ad-122f-46b6-adb8-f6052b3f5571-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-quobyte-155d11ad-122f-46b6-adb8-f6052b3f5571" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-155d11ad-122f-46b6-adb8-f6052b3f5571" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94dc969-a2d4-4b86-b469-ba40572b01c8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:44 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 Sep 09 14:57:44 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:44 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571" returned: 0 in 0.341s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:44 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571 Sep 09 14:57:44 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:44 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-155d11ad-122f-46b6-adb8-f6052b3f5571" returned: 0 in 0.238s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-155d11ad-122f-46b6-adb8-f6052b3f5571" released by "delete_volume" :: held 0.616s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Created reservations ['653ee331-757c-4b05-bf6e-74264a2b8c00', '3365b9e4-1234-4455-b545-a9bfa6ef0415', '6ced46a3-5d9f-4d19-9756-35c0e0f45e9f', 'a8c45aab-bfa5-46a7-a251-57e53027f4d7'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:45 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:45 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:45 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.237s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:45 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Deleted volume successfully. Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c98457d3-d4fd-404c-b921-3ea01896890b tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-155d11ad-122f-46b6-adb8-f6052b3f5571-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-71050657-099d-4b08-a2f8-8fa0bf6efef4-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-71050657-099d-4b08-a2f8-8fa0bf6efef4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-quobyte-71050657-099d-4b08-a2f8-8fa0bf6efef4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-71050657-099d-4b08-a2f8-8fa0bf6efef4" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c8da0c-6f8e-404f-8d27-54cf14b44328]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:45 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 Sep 09 14:57:45 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:45 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4" returned: 0 in 0.339s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:45 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4 Sep 09 14:57:45 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:46 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-71050657-099d-4b08-a2f8-8fa0bf6efef4" returned: 0 in 0.242s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-71050657-099d-4b08-a2f8-8fa0bf6efef4" released by "delete_volume" :: held 0.618s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Created reservations ['819081ba-fa1a-4bb8-a669-765791860e08', 'b2931d8f-1b33-4ce2-96ea-1f6d9b355429', '201b7c36-f4b3-4754-8df5-c83cdd7a1dd3', '5892ff58-f4aa-4426-bd86-b7c57de4a4c0'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:46 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:46 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:46 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Deleted volume successfully. Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6812df16-8fb3-440d-af89-681ff7210d94 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-71050657-099d-4b08-a2f8-8fa0bf6efef4-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-a886fde4-3af1-4a5c-9dc8-95cb8827e2be-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-a886fde4-3af1-4a5c-9dc8-95cb8827e2be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-quobyte-a886fde4-3af1-4a5c-9dc8-95cb8827e2be" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-a886fde4-3af1-4a5c-9dc8-95cb8827e2be" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96eed3-3476-4ed2-acbf-532c13f771c2]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:46 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be Sep 09 14:57:46 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:46 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be" returned: 0 in 0.346s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:46 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be Sep 09 14:57:46 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:47 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a886fde4-3af1-4a5c-9dc8-95cb8827e2be" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-a886fde4-3af1-4a5c-9dc8-95cb8827e2be" released by "delete_volume" :: held 0.621s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Created reservations ['2ddad256-816a-42f1-ba0e-0459122c68a1', '5abc08b7-3e69-44c7-b495-6b3a4cdbb99d', 'dd92d20e-91ac-41a3-88d5-9f5be2e88c28', '64cb2dbe-ee22-4298-a416-6e3c65a45b52'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:47 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:47 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:47 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Deleted volume successfully. Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3f7fdb69-b3e6-46c3-9476-e540da816812 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-a886fde4-3af1-4a5c-9dc8-95cb8827e2be-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-95c95778-723c-4033-aab1-0daf968f2833-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-95c95778-723c-4033-aab1-0daf968f2833-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-quobyte-95c95778-723c-4033-aab1-0daf968f2833" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-95c95778-723c-4033-aab1-0daf968f2833" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad61797-b2e4-4883-81fd-6f9ebef76319]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:47 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 Sep 09 14:57:47 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:48 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833" returned: 0 in 0.355s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:48 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833 Sep 09 14:57:48 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:48 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-95c95778-723c-4033-aab1-0daf968f2833" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-95c95778-723c-4033-aab1-0daf968f2833" released by "delete_volume" :: held 0.639s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Created reservations ['b9123b01-a21c-4f52-9618-a5054311d948', '3067a349-afeb-43ed-b965-49e4bf11c0ea', '3a7e3125-5148-4afc-b556-da1e44923bd5', 'b4aef3c1-fefd-4285-9ea2-4883112c24ae'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:48 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:48 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:48 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.233s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Deleted volume successfully. Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-048e1270-7e83-44e6-8869-5da68b639f11 tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-95c95778-723c-4033-aab1-0daf968f2833-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-030775c0-4cac-48c7-96ef-6c8c98fbda02-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-030775c0-4cac-48c7-96ef-6c8c98fbda02-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "cinder-quobyte-030775c0-4cac-48c7-96ef-6c8c98fbda02" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-030775c0-4cac-48c7-96ef-6c8c98fbda02" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a2dd40-f89a-4ff0-ad6a-4e2e12235046]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:48 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 Sep 09 14:57:48 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:49 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02" returned: 0 in 0.351s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:49 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02 Sep 09 14:57:49 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:49 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-030775c0-4cac-48c7-96ef-6c8c98fbda02" returned: 0 in 0.234s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-quobyte-030775c0-4cac-48c7-96ef-6c8c98fbda02" released by "delete_volume" :: held 0.621s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Created reservations ['a7a26448-5283-4c65-988f-efb06a9b2727', '97905c94-86bf-41c8-8b9c-0d7e9c01851e', 'cccb04fe-7efd-428b-9dd2-4f904527d3e8', '587c3b53-dfc5-45c8-ba22-ba405b2a9ac1'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:49 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:49 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:49 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Deleted volume successfully. Sep 09 14:57:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8daea5cc-8fbc-4473-8f1d-9499d57a125c tempest-CreateVolumesFromImageTest-809676517 None] Lock "cinder-030775c0-4cac-48c7-96ef-6c8c98fbda02-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:52 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:57:52 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:52 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Flow 'volume_create_manager' (0c88bf69-8a59-4cf1-91ab-008d90457d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b1294-567a-4396-ac6c-b51291d6498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b1294-567a-4396-ac6c-b51291d6498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ade652-c5e0-4057-bc97-3552bb9e5f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35649c8f0d254267963a2d45a2b3027b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:53Z,use_quota=True,user_id='7ea7cd35791044d1ba5ac10144ce0343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6421d7db-79bb-473b-a3fb-a4d1a139ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6421d7db-79bb-473b-a3fb-a4d1a139ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed007b7-4b95-4749-a529-1af4698a2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed007b7-4b95-4749-a529-1af4698a2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ade652-c5e0-4057-bc97-3552bb9e5f3d', 'volume_name': 'volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8813e2fd-2ec4-4915-b41a-edac6296dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8813e2fd-2ec4-4915-b41a-edac6296dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa249eb-a16b-464d-b5fc-f8ce282bceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:52 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Volume 86ade652-c5e0-4057-bc97-3552bb9e5f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d', 'volume_size': 1} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ade652-c5e0-4057-bc97-3552bb9e5f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35649c8f0d254267963a2d45a2b3027b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:53Z,use_quota=True,user_id='7ea7cd35791044d1ba5ac10144ce0343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Creating volume 86ade652-c5e0-4057-bc97-3552bb9e5f3d {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:52 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:52 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d 1073741824 Sep 09 14:57:52 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:53 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d 1073741824" returned: 0 in 0.394s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:53 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d Sep 09 14:57:53 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:53 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d" returned: 0 in 0.234s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa249eb-a16b-464d-b5fc-f8ce282bceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2c61a5-9d89-4394-9d6a-7680b7244f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Volume volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d (86ade652-c5e0-4057-bc97-3552bb9e5f3d): created successfully Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2c61a5-9d89-4394-9d6a-7680b7244f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Flow 'volume_create_manager' (0c88bf69-8a59-4cf1-91ab-008d90457d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a59f05bb-c1e8-49fc-9435-44c042653251 tempest-CinderUnicodeTest-1448541078 None] Created volume successfully. Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Flow 'volume_create_manager' (28e7f079-f347-48ef-b081-891b34ac9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2362b5cc-cb49-4d0b-bead-4ecc20514e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2362b5cc-cb49-4d0b-bead-4ecc20514e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-239718034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb975a7-c020-4d7c-aec9-4e7af9293ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35649c8f0d254267963a2d45a2b3027b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:54Z,use_quota=True,user_id='7ea7cd35791044d1ba5ac10144ce0343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b57b7e-4180-47c0-b32b-a5e769136bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b57b7e-4180-47c0-b32b-a5e769136bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8237cb-ca29-4f9b-bb9d-9db0a8d8a106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8237cb-ca29-4f9b-bb9d-9db0a8d8a106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb975a7-c020-4d7c-aec9-4e7af9293ae3', 'volume_name': 'volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54be7232-1cf2-46ef-99ba-22be53a9f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54be7232-1cf2-46ef-99ba-22be53a9f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f493f29b-ad29-4139-8afd-5289ea002041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:54 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Volume adb975a7-c020-4d7c-aec9-4e7af9293ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3', 'volume_size': 1} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:57:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-239718034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb975a7-c020-4d7c-aec9-4e7af9293ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35649c8f0d254267963a2d45a2b3027b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:57:54Z,use_quota=True,user_id='7ea7cd35791044d1ba5ac10144ce0343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Creating volume adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:57:54 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:54 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 1073741824 Sep 09 14:57:54 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:54 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 1073741824" returned: 0 in 0.393s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:54 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 Sep 09 14:57:54 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:54 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3" returned: 0 in 0.238s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f493f29b-ad29-4139-8afd-5289ea002041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a52862c-c233-4191-b5dc-bb0282ba156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:57:54 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Volume volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 (adb975a7-c020-4d7c-aec9-4e7af9293ae3): created successfully Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a52862c-c233-4191-b5dc-bb0282ba156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:57:54 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Flow 'volume_create_manager' (28e7f079-f347-48ef-b081-891b34ac9727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:57:54 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7f6f2947-7388-475d-b881-0d35fc72a4dc tempest-CinderUnicodeTest-1448541078 None] Created volume successfully. Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Creating offline snapshot 7425832c-e735-4e92-a354-87121ccde0bb of volume adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbacb71-a95d-4d04-b23e-a27edb135796]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:55 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 Sep 09 14:57:55 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:55 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3" returned: 0 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:55 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb 1G Sep 09 14:57:55 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:56 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb 1G" returned: 0 in 0.376s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:56 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb Sep 09 14:57:56 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:56 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb" returned: 0 in 0.287s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:56 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb is being set with open permissions: ugo+rw Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:56 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb Sep 09 14:57:56 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:56 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb" returned: 0 in 0.238s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:56 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info Sep 09 14:57:56 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:56 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info" returned: 0 in 0.251s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:56 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info is being set with open permissions: ugo+rw Sep 09 14:57:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:56 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info Sep 09 14:57:56 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:57 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.info" returned: 0 in 0.235s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:57:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9a93fb94-099f-4a7e-9e23-528fc862d7c2 tempest-CinderUnicodeTest-1448541078 None] Create snapshot completed successfully Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-7425832c-e735-4e92-a354-87121ccde0bb-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-7425832c-e735-4e92-a354-87121ccde0bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-quobyte-adb975a7-c020-4d7c-aec9-4e7af9293ae3" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-adb975a7-c020-4d7c-aec9-4e7af9293ae3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-quobyte-7425832c-e735-4e92-a354-87121ccde0bb" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-7425832c-e735-4e92-a354-87121ccde0bb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Deleting offline snapshot 7425832c-e735-4e92-a354-87121ccde0bb of volume adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] snapshot_file for this snap is: volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[03894b22-5e85-4fcd-acea-7b2863fdc408]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:57 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb Sep 09 14:57:57 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:57 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb" returned: 0 in 0.335s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f16486-4485-4106-843f-1e7ae86db81d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:57 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 Sep 09 14:57:57 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:58 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3" returned: 0 in 0.337s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:58 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb Sep 09 14:57:58 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:58 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb" returned: 0 in 0.324s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:57:58 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb Sep 09 14:57:58 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:57:58 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3.7425832c-e735-4e92-a354-87121ccde0bb" returned: 0 in 0.232s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-7425832c-e735-4e92-a354-87121ccde0bb" released by "_delete_snapshot" :: held 1.317s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-adb975a7-c020-4d7c-aec9-4e7af9293ae3" released by "delete_snapshot" :: held 1.339s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Created reservations ['d10f4a50-0845-4d07-854a-97ff8777fddf', '05adafc9-636f-48a3-81f4-284838c8cb2c', '0c6299de-6c02-45d3-9116-d4cee7606664', '438533e4-4c32-48dd-9e49-1820b1f522e9'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:57:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Delete snapshot completed successfully. Sep 09 14:57:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbe4c46c-e3d8-4656-8825-7d4463613fe9 tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-7425832c-e735-4e92-a354-87121ccde0bb-delete_snapshot" released by "delete_snapshot" :: held 1.459s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:57:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-adb975a7-c020-4d7c-aec9-4e7af9293ae3-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-adb975a7-c020-4d7c-aec9-4e7af9293ae3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-quobyte-adb975a7-c020-4d7c-aec9-4e7af9293ae3" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:57:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-adb975a7-c020-4d7c-aec9-4e7af9293ae3" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:57:59 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35996a9-1e8f-4511-ab7a-3edb774fa5da]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:57:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:00 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 Sep 09 14:58:00 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:00 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3" returned: 0 in 0.367s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:00 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3 Sep 09 14:58:00 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:00 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-adb975a7-c020-4d7c-aec9-4e7af9293ae3" returned: 0 in 0.234s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-adb975a7-c020-4d7c-aec9-4e7af9293ae3" released by "delete_volume" :: held 0.661s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Created reservations ['2aa268d2-7b62-4c06-b7f8-2bb077707e9a', '33583eba-e682-4b41-a655-c4fd2c915eee', '957511d7-a2e5-440f-aeb4-0b142d9df512', '778fe57c-ab6d-414e-895c-496c2cc3dd59'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:00 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:00 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:00 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.232s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:00 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Deleted volume successfully. Sep 09 14:58:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d817e439-9739-4666-8584-bfcbcae2e34b tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-adb975a7-c020-4d7c-aec9-4e7af9293ae3-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-86ade652-c5e0-4057-bc97-3552bb9e5f3d-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-86ade652-c5e0-4057-bc97-3552bb9e5f3d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "cinder-quobyte-86ade652-c5e0-4057-bc97-3552bb9e5f3d" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-86ade652-c5e0-4057-bc97-3552bb9e5f3d" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c31910-80f7-44e0-8027-33853571e6fa]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:01 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d Sep 09 14:58:01 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:01 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:01 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d Sep 09 14:58:01 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:01 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-86ade652-c5e0-4057-bc97-3552bb9e5f3d" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-quobyte-86ade652-c5e0-4057-bc97-3552bb9e5f3d" released by "delete_volume" :: held 0.674s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Created reservations ['8ac6bea6-73e7-45b6-9694-ef82666633c4', 'ef4de0bf-29d6-4167-bb5a-817d3acc4cef', '890d9903-123d-4ae4-b7f2-d48040b31827', 'd8b5ece4-bef2-4259-a949-62b1871dce72'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:01 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:01 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:02 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:02 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Deleted volume successfully. Sep 09 14:58:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d9ac7220-50b1-4b52-9ef8-7e02a47d90fb tempest-CinderUnicodeTest-1448541078 None] Lock "cinder-86ade652-c5e0-4057-bc97-3552bb9e5f3d-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:11 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=53,cinder:UPDATE=88,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:58:12 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=80,cinder:SELECT=63,cinder:DELETE=9,cinder:INSERT=16 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (58bccfee-18d7-406a-ac1c-6df6ea02ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eef7388-8d9d-49d9-9024-b2563c6ae246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eef7388-8d9d-49d9-9024-b2563c6ae246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174401336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb6b194-8bc7-4542-aea9-ff6dc12b945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:18Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8572cb81-5c7b-42cc-bbfb-2dd10eb8c638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8572cb81-5c7b-42cc-bbfb-2dd10eb8c638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff2c42b-9baf-4084-a936-9a07aef015c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff2c42b-9baf-4084-a936-9a07aef015c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb6b194-8bc7-4542-aea9-ff6dc12b945e', 'volume_name': 'volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0be0d3a-e530-444a-bda2-2ddf29653588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0be0d3a-e530-444a-bda2-2ddf29653588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182fc65d-5725-40eb-aaa1-054530b02b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:17 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume 0bb6b194-8bc7-4542-aea9-ff6dc12b945e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e', 'volume_size': 1} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174401336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb6b194-8bc7-4542-aea9-ff6dc12b945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:18Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Creating volume 0bb6b194-8bc7-4542-aea9-ff6dc12b945e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:17 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:18 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e 1073741824 Sep 09 14:58:18 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (4ac1029c-f580-4c55-abe9-1b5d32c66e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d97ebdc-c4ed-4330-84d6-be500a6e67e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d97ebdc-c4ed-4330-84d6-be500a6e67e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932872405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bebcf76b-6517-4a6a-939f-e91dbae7061f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:18Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee48263d-f009-414b-9147-adb949909f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee48263d-f009-414b-9147-adb949909f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d879c81-7436-40bd-b061-b13b87acb76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d879c81-7436-40bd-b061-b13b87acb76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bebcf76b-6517-4a6a-939f-e91dbae7061f', 'volume_name': 'volume-bebcf76b-6517-4a6a-939f-e91dbae7061f', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a101d3e-220c-473e-834b-14334a71c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a101d3e-220c-473e-834b-14334a71c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedfb14b-899b-46b1-90a0-f33f008dc7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Volume bebcf76b-6517-4a6a-939f-e91dbae7061f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bebcf76b-6517-4a6a-939f-e91dbae7061f', 'volume_size': 1} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (5ec33219-e432-4f4d-96f2-dee4aa281548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49051ab4-86d6-491c-8b28-e27031de1be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49051ab4-86d6-491c-8b28-e27031de1be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1602468787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26138b3c-8b15-4800-9982-df0c3aa099c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:18Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5f0242-c01c-4e8b-b8fa-ab855632df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5f0242-c01c-4e8b-b8fa-ab855632df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14494908-1148-4dd6-aac2-4de2ebe84aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14494908-1148-4dd6-aac2-4de2ebe84aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26138b3c-8b15-4800-9982-df0c3aa099c8', 'volume_name': 'volume-26138b3c-8b15-4800-9982-df0c3aa099c8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e813934-146b-46d1-894b-93806c12fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e813934-146b-46d1-894b-93806c12fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afb0b98-f997-4ad7-9495-84ee2f749e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Volume 26138b3c-8b15-4800-9982-df0c3aa099c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26138b3c-8b15-4800-9982-df0c3aa099c8', 'volume_size': 1} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:18 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e 1073741824" returned: 0 in 0.545s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:18 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e Sep 09 14:58:18 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (bd4fa91f-52c6-4111-95de-2a67f3b6728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6124a7-9adf-4e59-8d3f-2c41c8de5504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6124a7-9adf-4e59-8d3f-2c41c8de5504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866064736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d878759d-e6e6-4434-8ec3-838c4360e86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:19Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee7db71-2d73-4fe4-8fb6-b029099d832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee7db71-2d73-4fe4-8fb6-b029099d832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9666bacf-e410-41bb-bbb0-7d8b06e4c797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9666bacf-e410-41bb-bbb0-7d8b06e4c797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd878759d-e6e6-4434-8ec3-838c4360e86f', 'volume_name': 'volume-d878759d-e6e6-4434-8ec3-838c4360e86f', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01782113-1487-4e69-8af1-c28391b04132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01782113-1487-4e69-8af1-c28391b04132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadc6675-8e39-47e5-8455-549c946bd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:18 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Volume d878759d-e6e6-4434-8ec3-838c4360e86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d878759d-e6e6-4434-8ec3-838c4360e86f', 'volume_size': 1} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932872405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bebcf76b-6517-4a6a-939f-e91dbae7061f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:18Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Creating volume bebcf76b-6517-4a6a-939f-e91dbae7061f {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:18 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182fc65d-5725-40eb-aaa1-054530b02b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aa2c3c-5a44-4b0d-8092-ec0ad655069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f 1073741824 Sep 09 14:58:19 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e (0bb6b194-8bc7-4542-aea9-ff6dc12b945e): created successfully Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aa2c3c-5a44-4b0d-8092-ec0ad655069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (58bccfee-18d7-406a-ac1c-6df6ea02ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0af34e3c-ffd8-4b01-82f0-3f22e68d6366 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created volume successfully. Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (9d5ae9c1-e5e5-4531-b902-b7ff75ec4187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6d334f-abe0-44e5-841a-d802a13191b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6d334f-abe0-44e5-841a-d802a13191b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1222767333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9a874f-90ea-489f-b4a4-ab209b585fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:19Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ff9a25-b643-4b8f-bdf7-8f43960f5fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ff9a25-b643-4b8f-bdf7-8f43960f5fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3689e7-7e04-40d8-998c-b65b3bd7d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3689e7-7e04-40d8-998c-b65b3bd7d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9a874f-90ea-489f-b4a4-ab209b585fda', 'volume_name': 'volume-3b9a874f-90ea-489f-b4a4-ab209b585fda', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51db37d6-f6e2-429b-99a9-47999e2e4732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51db37d6-f6e2-429b-99a9-47999e2e4732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a8e34c-87a8-472e-85d7-5578bdde3aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Volume 3b9a874f-90ea-489f-b4a4-ab209b585fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9a874f-90ea-489f-b4a4-ab209b585fda', 'volume_size': 1} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:19 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f 1073741824" returned: 0 in 0.635s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:19 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f Sep 09 14:58:19 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (6ecf505c-f02f-411f-bf3a-07c7d2244522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e47aea0-f5ec-4216-a386-0effb2953f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e47aea0-f5ec-4216-a386-0effb2953f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580412499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3519f1-e1a6-42ee-9611-012e0f0cc83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:19Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b542aab0-10e7-46b1-914e-1ac758f10f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b542aab0-10e7-46b1-914e-1ac758f10f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53ee67c-7b99-49c6-bda4-99666ba35f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53ee67c-7b99-49c6-bda4-99666ba35f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3519f1-e1a6-42ee-9611-012e0f0cc83b', 'volume_name': 'volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028f58e7-6afa-40f0-9c70-4cd331c87a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028f58e7-6afa-40f0-9c70-4cd331c87a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78155a0f-eec3-444d-92a5-99155c8d39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Volume 1d3519f1-e1a6-42ee-9611-012e0f0cc83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b', 'volume_size': 1} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (9bb1ce2e-a81d-40de-8b39-4bcebe4d9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02630099-99f3-4a0e-b8d3-eef88f4913ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02630099-99f3-4a0e-b8d3-eef88f4913ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451420362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b88727d-4739-4b80-9819-292beb32ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:20Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191c80dc-d4fc-4e6c-b346-568eb4ecfd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191c80dc-d4fc-4e6c-b346-568eb4ecfd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02838aa-2b79-43ac-a8ef-d3c5a053f885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02838aa-2b79-43ac-a8ef-d3c5a053f885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b88727d-4739-4b80-9819-292beb32ec3d', 'volume_name': 'volume-4b88727d-4739-4b80-9819-292beb32ec3d', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f78bd5-02ac-4fea-ada0-c08a60ac64c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f78bd5-02ac-4fea-ada0-c08a60ac64c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e2b0a-08d4-46b4-819b-ed8072e9f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Volume 4b88727d-4739-4b80-9819-292beb32ec3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b88727d-4739-4b80-9819-292beb32ec3d', 'volume_size': 1} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f" returned: 0 in 0.279s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1602468787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26138b3c-8b15-4800-9982-df0c3aa099c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:18Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Creating volume 26138b3c-8b15-4800-9982-df0c3aa099c8 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedfb14b-899b-46b1-90a0-f33f008dc7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bebcf76b-6517-4a6a-939f-e91dbae7061f', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:19 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 1073741824 Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a34757c-28c9-4cfd-8b90-e53041c4c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:19 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Volume volume-bebcf76b-6517-4a6a-939f-e91dbae7061f (bebcf76b-6517-4a6a-939f-e91dbae7061f): created successfully Sep 09 14:58:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a34757c-28c9-4cfd-8b90-e53041c4c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (4ac1029c-f580-4c55-abe9-1b5d32c66e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-fef351ff-14e0-41f9-9ac3-65ccade9870d tempest-CreateVolumesFromImageTest-1525675244 None] Created volume successfully. Sep 09 14:58:20 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 1073741824" returned: 0 in 0.552s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:20 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 Sep 09 14:58:20 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:20 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8" returned: 0 in 0.301s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866064736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d878759d-e6e6-4434-8ec3-838c4360e86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:19Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Creating volume d878759d-e6e6-4434-8ec3-838c4360e86f {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:20 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afb0b98-f997-4ad7-9495-84ee2f749e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26138b3c-8b15-4800-9982-df0c3aa099c8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077bae6-8f1a-4fca-8f06-4169950a49e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:20 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f 1073741824 Sep 09 14:58:20 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (2c75865d-770a-46c1-8b73-cfbe20ac7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8eea941-4088-4561-9379-1660972e988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:20 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Volume volume-26138b3c-8b15-4800-9982-df0c3aa099c8 (26138b3c-8b15-4800-9982-df0c3aa099c8): created successfully Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077bae6-8f1a-4fca-8f06-4169950a49e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (5ec33219-e432-4f4d-96f2-dee4aa281548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-17514dc7-8954-4f83-ae48-0980b7380ed4 tempest-CreateVolumesFromImageTest-1525675244 None] Created volume successfully. Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8eea941-4088-4561-9379-1660972e988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987651282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6452e4-eac3-4337-ae95-83d24b4b9fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:21Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd66cbea-e6db-423e-be0d-dea4530a93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd66cbea-e6db-423e-be0d-dea4530a93cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ea8ba2-ae23-40f9-ae0f-2bb5a74d9bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ea8ba2-ae23-40f9-ae0f-2bb5a74d9bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6452e4-eac3-4337-ae95-83d24b4b9fdc', 'volume_name': 'volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9c9e00-355a-4fa4-8d86-78d394bbade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9c9e00-355a-4fa4-8d86-78d394bbade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bdb133-7e37-42f4-a082-232276ac5800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume 8e6452e4-eac3-4337-ae95-83d24b4b9fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc', 'volume_size': 1} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (a9dd281a-75a5-4616-a2f9-71538545749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bee7af-5790-4d22-9bd4-0a805c2ede9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bee7af-5790-4d22-9bd4-0a805c2ede9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1507806643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6fd05e-be0c-4af7-ab23-4f27b2448f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:21Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abc56af-e92f-4692-acde-d8396400d90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abc56af-e92f-4692-acde-d8396400d90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448ae42d-45de-4199-98b3-b07aeddd89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448ae42d-45de-4199-98b3-b07aeddd89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6fd05e-be0c-4af7-ab23-4f27b2448f5b', 'volume_name': 'volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248e66b3-35b4-4c39-b222-80150ed20688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248e66b3-35b4-4c39-b222-80150ed20688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737cd79c-1f1e-4fda-a0cd-6659de478c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume 9e6fd05e-be0c-4af7-ab23-4f27b2448f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b', 'volume_size': 1} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:21 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f 1073741824" returned: 0 in 0.614s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:21 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f Sep 09 14:58:21 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (96fe4550-3685-4e29-8391-b4217e6072c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d041bbb7-bb23-47c4-8db6-36d0a6762e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d041bbb7-bb23-47c4-8db6-36d0a6762e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125757465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b59f0d-06e7-40cd-a9ea-563c0af9b8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:22Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bae25b-b5db-44a6-8cc2-d089276604a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bae25b-b5db-44a6-8cc2-d089276604a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dab86e1-1350-448f-845a-edeec75d2adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dab86e1-1350-448f-845a-edeec75d2adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b59f0d-06e7-40cd-a9ea-563c0af9b8b9', 'volume_name': 'volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2249dd06-12d6-4094-b34e-b71f5d7f3895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2249dd06-12d6-4094-b34e-b71f5d7f3895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea61a396-1e47-47b0-8440-5ea6bbfb098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume 91b59f0d-06e7-40cd-a9ea-563c0af9b8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9', 'volume_size': 1} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:21 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f" returned: 0 in 0.342s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1222767333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9a874f-90ea-489f-b4a4-ab209b585fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:19Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Creating volume 3b9a874f-90ea-489f-b4a4-ab209b585fda {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:21 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadc6675-8e39-47e5-8455-549c946bd92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d878759d-e6e6-4434-8ec3-838c4360e86f', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da88c53-4c4d-4671-9fb9-668fe0b42867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:21 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda 1073741824 Sep 09 14:58:21 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:21 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Volume volume-d878759d-e6e6-4434-8ec3-838c4360e86f (d878759d-e6e6-4434-8ec3-838c4360e86f): created successfully Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da88c53-4c4d-4671-9fb9-668fe0b42867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:21 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (bd4fa91f-52c6-4111-95de-2a67f3b6728e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-847a137b-63f7-4f5d-b06d-d60c1c931401 tempest-CreateVolumesFromImageTest-1525675244 None] Created volume successfully. Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (2ca36387-8154-4c53-98dc-4b88422f5bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c0aecf-d97e-4339-a739-72412564db19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c0aecf-d97e-4339-a739-72412564db19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1738829264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a93766-61d6-4d6e-9f40-48b866ba6c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:22Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6747878-9d6a-478a-bd1f-c8255e45ecf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6747878-9d6a-478a-bd1f-c8255e45ecf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f1d6b9-e4e1-4e57-8f68-27eb73e8da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f1d6b9-e4e1-4e57-8f68-27eb73e8da3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a93766-61d6-4d6e-9f40-48b866ba6c67', 'volume_name': 'volume-60a93766-61d6-4d6e-9f40-48b866ba6c67', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0408ebea-365a-4b00-bf37-440300c71864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0408ebea-365a-4b00-bf37-440300c71864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cbf428-8873-41e3-8a3e-cc93f675e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume 60a93766-61d6-4d6e-9f40-48b866ba6c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a93766-61d6-4d6e-9f40-48b866ba6c67', 'volume_size': 1} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:22 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda 1073741824" returned: 0 in 0.597s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:22 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda Sep 09 14:58:22 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:22 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda" returned: 0 in 0.255s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.973s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580412499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3519f1-e1a6-42ee-9611-012e0f0cc83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:19Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Creating volume 1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:22 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:22 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b 1073741824 Sep 09 14:58:22 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a8e34c-87a8-472e-85d7-5578bdde3aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9a874f-90ea-489f-b4a4-ab209b585fda', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0449bf-f400-4b01-859a-4247dbd72ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Volume volume-3b9a874f-90ea-489f-b4a4-ab209b585fda (3b9a874f-90ea-489f-b4a4-ab209b585fda): created successfully Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0449bf-f400-4b01-859a-4247dbd72ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (9d5ae9c1-e5e5-4531-b902-b7ff75ec4187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Flow 'volume_create_manager' (96d7e1e9-6cdc-4eb1-813f-5d3371ed1951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8ed1f2-ca93-4031-8c2b-cf613b25653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (728d629b-152d-40d1-aa16-5f122da9aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f24f12-ee12-4b2f-bb03-e807de900386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c53dca87-4062-4ea6-b840-effd4337aa86 tempest-CreateVolumesFromImageTest-1525675244 None] Created volume successfully. Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8ed1f2-ca93-4031-8c2b-cf613b25653c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72042a9-c6a0-4228-9c7d-b2373e374eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee394595d6a7440e98d996ad44fa6b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:23Z,use_quota=True,user_id='2062884e76e44c33aa86077c2a081245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8ce68cd-88f0-4991-ad04-0358476f9d2f),volume_type_id=b8ce68cd-88f0-4991-ad04-0358476f9d2f)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5470f1-2d3c-4ff2-ad95-fd2c173393bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:22 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5470f1-2d3c-4ff2-ad95-fd2c173393bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21938ab-9fd9-41e7-acab-109e260429bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f24f12-ee12-4b2f-bb03-e807de900386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261131149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be15c22-991a-4d07-be9a-89aeaa1ddce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:23Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd5fadf-b373-4f5e-b2cf-2ac60961ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd5fadf-b373-4f5e-b2cf-2ac60961ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ff957f-b82a-4e1b-aedb-6e2253c23c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ff957f-b82a-4e1b-aedb-6e2253c23c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be15c22-991a-4d07-be9a-89aeaa1ddce3', 'volume_name': 'volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3557b5-f68d-4c26-9317-9ca3eada1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3557b5-f68d-4c26-9317-9ca3eada1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd09487-bde9-4611-a258-7102c7233124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume 8be15c22-991a-4d07-be9a-89aeaa1ddce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3', 'volume_size': 1} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:23 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b 1073741824" returned: 0 in 0.483s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21938ab-9fd9-41e7-acab-109e260429bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b72042a9-c6a0-4228-9c7d-b2373e374eb8', 'volume_name': 'volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8', 'volume_size': 1, 'image_id': 'ec807b07-6080-4684-bb01-7010595fa579', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec807b07-6080-4684-bb01-7010595fa579', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed01cc031c3f08c5172c2ec6c9b00eee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee394595d6a7440e98d996ad44fa6b6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eb58308dd51a1b0fe5591a4ddb54d2fd8346a7e79962d3a989dc01148b2e68fcb8a2befd5304a92a5de4b391d62c883b915b862c5aee4556317f520439e1900', 'id': 'ec807b07-6080-4684-bb01-7010595fa579', 'created_at': datetime.datetime(2026, 9, 9, 12, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 58, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec807b07-6080-4684-bb01-7010595fa579/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6d0043-d3f5-482c-aced-3c33662923fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6d0043-d3f5-482c-aced-3c33662923fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a08f23-cccd-4976-a579-caeec8615a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Volume b72042a9-c6a0-4228-9c7d-b2373e374eb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8', 'volume_size': 1, 'image_id': 'ec807b07-6080-4684-bb01-7010595fa579', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec807b07-6080-4684-bb01-7010595fa579', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed01cc031c3f08c5172c2ec6c9b00eee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee394595d6a7440e98d996ad44fa6b6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eb58308dd51a1b0fe5591a4ddb54d2fd8346a7e79962d3a989dc01148b2e68fcb8a2befd5304a92a5de4b391d62c883b915b862c5aee4556317f520439e1900', 'id': 'ec807b07-6080-4684-bb01-7010595fa579', 'created_at': datetime.datetime(2026, 9, 9, 12, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 58, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec807b07-6080-4684-bb01-7010595fa579/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Trying to clone b72042a9-c6a0-4228-9c7d-b2373e374eb8 from image ec807b07-6080-4684-bb01-7010595fa579 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec807b07-6080-4684-bb01-7010595fa579', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:23 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b Sep 09 14:58:23 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:58:23 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Image download 0.00 MB at 0.00 MB/s Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2739b5b-f4e1-4e9e-96c5-1031405ae5ee]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:23 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" returned: 0 in 0.268s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:23 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD Sep 09 14:58:23 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.702s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451420362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b88727d-4739-4b80-9819-292beb32ec3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d876bb6db764bbc97c8459e46cd02de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:20Z,use_quota=True,user_id='0469b9ff035742d884e8f400c48e64fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Creating volume 4b88727d-4739-4b80-9819-292beb32ec3d {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:23 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:23 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d 1073741824 Sep 09 14:58:23 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78155a0f-eec3-444d-92a5-99155c8d39b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad1adcd-a06b-45f2-8379-609c6d1c881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Volume volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b (1d3519f1-e1a6-42ee-9611-012e0f0cc83b): created successfully Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad1adcd-a06b-45f2-8379-609c6d1c881e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (6ecf505c-f02f-411f-bf3a-07c7d2244522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-04cd92d2-89aa-4cc5-8f63-8ac72d74e20f tempest-ProjectReaderTests-803268646 None] Created volume successfully. Sep 09 14:58:23 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:23 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD Sep 09 14:58:23 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:24 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d 1073741824" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:24 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d Sep 09 14:58:24 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:24 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Temporary image ec807b07-6080-4684-bb01-7010595fa579 is fetched for user 2062884e76e44c33aa86077c2a081245. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65a86c0-f332-43a0-9a47-6af4e16e969c]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:24 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:24 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD Sep 09 14:58:24 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987651282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6452e4-eac3-4337-ae95-83d24b4b9fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:21Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Creating volume 8e6452e4-eac3-4337-ae95-83d24b4b9fdc {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:24 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e2b0a-08d4-46b4-819b-ed8072e9f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b88727d-4739-4b80-9819-292beb32ec3d', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:24 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc 1073741824 Sep 09 14:58:24 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b918b70-c613-48b5-bbff-7afa1c24426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:24 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Volume volume-4b88727d-4739-4b80-9819-292beb32ec3d (4b88727d-4739-4b80-9819-292beb32ec3d): created successfully Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b918b70-c613-48b5-bbff-7afa1c24426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Flow 'volume_create_manager' (9bb1ce2e-a81d-40de-8b39-4bcebe4d9775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b9406508-8123-4448-8826-bb78aec05650 tempest-CreateVolumesFromImageTest-1525675244 None] Created volume successfully. Sep 09 14:58:24 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:24 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD Sep 09 14:58:24 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:24 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc 1073741824" returned: 0 in 0.546s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-4b88727d-4739-4b80-9819-292beb32ec3d-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-4b88727d-4739-4b80-9819-292beb32ec3d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:25 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:25 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-quobyte-4b88727d-4739-4b80-9819-292beb32ec3d" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:25 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-4b88727d-4739-4b80-9819-292beb32ec3d" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0e852-ffb0-42d3-9e8e-27f963b9234f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:25 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d Sep 09 14:58:25 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:25 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.886s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1507806643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6fd05e-be0c-4af7-ab23-4f27b2448f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:21Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Creating volume 9e6fd05e-be0c-4af7-ab23-4f27b2448f5b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:25 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bdb133-7e37-42f4-a082-232276ac5800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e320391-3494-4e33-9720-8835497db748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:25 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b 1073741824 Sep 09 14:58:25 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc (8e6452e4-eac3-4337-ae95-83d24b4b9fdc): created successfully Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e320391-3494-4e33-9720-8835497db748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (2c75865d-770a-46c1-8b73-cfbe20ac7e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8194feab-101d-4023-84aa-edcca63d46db tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created volume successfully. Sep 09 14:58:25 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d" returned: 0 in 0.382s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:25 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d Sep 09 14:58:25 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:25 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4b88727d-4739-4b80-9819-292beb32ec3d" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-4b88727d-4739-4b80-9819-292beb32ec3d" released by "delete_volume" :: held 0.701s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:25 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b 1073741824" returned: 0 in 0.458s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:25 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b Sep 09 14:58:25 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Created reservations ['7df969ef-5252-4e50-b0b5-02a928b6a556', 'df52ee73-068a-442c-b754-7892a8ee9ae6', '56c235fa-b8cc-4977-b92d-3fb4b67837c1', '43e1e863-3501-403e-b683-a080ce1438dd'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:25 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:25 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:26 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.341s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125757465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b59f0d-06e7-40cd-a9ea-563c0af9b8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:22Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Creating volume 91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:26 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737cd79c-1f1e-4fda-a0cd-6659de478c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa79246-2903-4272-a191-63cee99487d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:26 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 1073741824 Sep 09 14:58:26 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-3b9a874f-90ea-489f-b4a4-ab209b585fda-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b (9e6fd05e-be0c-4af7-ab23-4f27b2448f5b): created successfully Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa79246-2903-4272-a191-63cee99487d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (a9dd281a-75a5-4616-a2f9-71538545749c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:26 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-3b9a874f-90ea-489f-b4a4-ab209b585fda-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-82dd55b5-5613-4908-b5fe-df546087ac58 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created volume successfully. Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.334s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-quobyte-3b9a874f-90ea-489f-b4a4-ab209b585fda" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Deleted volume successfully. Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-3b9a874f-90ea-489f-b4a4-ab209b585fda" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca6104-93f9-46f9-bc9d-a2077ca1ad9b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5179c9a0-dc2a-4120-950e-8f9e48833d90 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-4b88727d-4739-4b80-9819-292beb32ec3d-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:26 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda Sep 09 14:58:26 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:26 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 1073741824" returned: 0 in 0.501s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:26 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 Sep 09 14:58:26 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:26 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda" returned: 0 in 0.420s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:26 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda Sep 09 14:58:26 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:26 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9" returned: 0 in 0.272s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.614s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1738829264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a93766-61d6-4d6e-9f40-48b866ba6c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:22Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Creating volume 60a93766-61d6-4d6e-9f40-48b866ba6c67 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:26 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea61a396-1e47-47b0-8440-5ea6bbfb098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737c895f-5b26-45ba-b692-85a7856d7589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:26 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 1073741824 Sep 09 14:58:26 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 (91b59f0d-06e7-40cd-a9ea-563c0af9b8b9): created successfully Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737c895f-5b26-45ba-b692-85a7856d7589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (96fe4550-3685-4e29-8391-b4217e6072c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5b57929e-73eb-423f-8839-dcf144484f09 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created volume successfully. Sep 09 14:58:27 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-3b9a874f-90ea-489f-b4a4-ab209b585fda" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-3b9a874f-90ea-489f-b4a4-ab209b585fda" released by "delete_volume" :: held 0.774s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Created reservations ['d5b2ada5-91d4-4884-8c25-ffc0e33bbcdd', 'b51e4788-bcd7-49ee-a144-d65e75e16d21', '4d954c83-d9aa-45d0-b02b-ca7ccdfb7db1', '3c347a2c-65f3-4c9a-a608-88aa337bee39'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:27 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:27 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-d878759d-e6e6-4434-8ec3-838c4360e86f-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-d878759d-e6e6-4434-8ec3-838c4360e86f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:27 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-quobyte-d878759d-e6e6-4434-8ec3-838c4360e86f" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Deleted volume successfully. Sep 09 14:58:27 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 1073741824" returned: 0 in 0.569s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-d878759d-e6e6-4434-8ec3-838c4360e86f" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e012e113-c444-488f-abed-60162345e78c tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-3b9a874f-90ea-489f-b4a4-ab209b585fda-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf4099-cf9f-4a87-baee-ecd114bd020b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:27 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 Sep 09 14:58:27 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:27 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f Sep 09 14:58:27 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:27 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67" returned: 0 in 0.248s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261131149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be15c22-991a-4d07-be9a-89aeaa1ddce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4322064294321948c83cbf4ec9bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:23Z,use_quota=True,user_id='87a57f113f3f4782bcfe7c199fabd670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Creating volume 8be15c22-991a-4d07-be9a-89aeaa1ddce3 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:27 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cbf428-8873-41e3-8a3e-cc93f675e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a93766-61d6-4d6e-9f40-48b866ba6c67', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:27 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 1073741824 Sep 09 14:58:27 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e59ba2-99e5-45a8-9638-84ce42fc18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:27 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 (60a93766-61d6-4d6e-9f40-48b866ba6c67): created successfully Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e59ba2-99e5-45a8-9638-84ce42fc18be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (2ca36387-8154-4c53-98dc-4b88422f5bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:27 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-690947b6-1d2c-4cd4-98fa-743d7f6c9a70 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created volume successfully. Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f" returned: 0 in 0.393s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:27 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f Sep 09 14:58:27 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:28 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-d878759d-e6e6-4434-8ec3-838c4360e86f" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-d878759d-e6e6-4434-8ec3-838c4360e86f" released by "delete_volume" :: held 0.731s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Created reservations ['9c9cc1a2-1494-411c-93b5-4fb9cf39ddca', '1db4a023-70d0-4aff-8258-f005aaea0d69', '98244e9a-2956-4ad3-af95-282a7da83e11', '2b477182-be04-4d2a-97f8-5cd3cdd1785d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:28 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 1073741824" returned: 0 in 0.488s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:28 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:28 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:28 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 Sep 09 14:58:28 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-26138b3c-8b15-4800-9982-df0c3aa099c8-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:28 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-26138b3c-8b15-4800-9982-df0c3aa099c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3" returned: 0 in 0.250s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.689s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:28 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.296s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Creating offline snapshot b7c3ab77-f705-4592-807a-d2c634a56fbf of volume 1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd09487-bde9-4611-a258-7102c7233124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc44d32e-d3cf-40f1-93aa-d70dd4a352fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbb2819-5d88-414a-afe0-1d08fae29b9c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Deleted volume successfully. Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-quobyte-26138b3c-8b15-4800-9982-df0c3aa099c8" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:28 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Volume volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 (8be15c22-991a-4d07-be9a-89aeaa1ddce3): created successfully Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc44d32e-d3cf-40f1-93aa-d70dd4a352fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Flow 'volume_create_manager' (728d629b-152d-40d1-aa16-5f122da9aed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-26138b3c-8b15-4800-9982-df0c3aa099c8" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3d6b8449-5de0-4576-9d6e-2f3e9aac28d2 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-d878759d-e6e6-4434-8ec3-838c4360e86f-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8293c525-ef79-4955-9e4b-f66354af35e8 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created volume successfully. Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cf5e91-9f19-4ddc-ba91-3f8a32413a0d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:28 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b Sep 09 14:58:28 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:28 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 Sep 09 14:58:28 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" returned: 0 in 0.406s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf 1G Sep 09 14:58:29 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8" returned: 0 in 0.407s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8 Sep 09 14:58:29 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-8be15c22-991a-4d07-be9a-89aeaa1ddce3-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-8be15c22-991a-4d07-be9a-89aeaa1ddce3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-quobyte-8be15c22-991a-4d07-be9a-89aeaa1ddce3" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-8be15c22-991a-4d07-be9a-89aeaa1ddce3" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:29 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-26138b3c-8b15-4800-9982-df0c3aa099c8" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf673d68-9a1b-4918-846e-b4502b9fb91c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-26138b3c-8b15-4800-9982-df0c3aa099c8" released by "delete_volume" :: held 0.768s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:29 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf 1G" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf Sep 09 14:58:29 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Created reservations ['603008bf-848d-4dbd-8f11-9ba41e068668', '66b06e2e-edad-457c-aa0d-fa43ca328215', 'cacf306a-bc95-4038-a8c9-7c162b1342d1', '6472f9c7-e29b-4371-9fc9-027b2e0bdb75'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:29 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 Sep 09 14:58:29 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:29 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-bebcf76b-6517-4a6a-939f-e91dbae7061f-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-bebcf76b-6517-4a6a-939f-e91dbae7061f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "cinder-quobyte-bebcf76b-6517-4a6a-939f-e91dbae7061f" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-bebcf76b-6517-4a6a-939f-e91dbae7061f" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:29 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:29 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf is being set with open permissions: ugo+rw Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb51975-45a0-41fd-9234-eff8f26c00f7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:29 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:29 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf Sep 09 14:58:29 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.318s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3" returned: 0 in 0.493s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Deleted volume successfully. Sep 09 14:58:30 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3 Sep 09 14:58:30 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9476aa9f-e67f-4345-a886-c49ef7172310 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-26138b3c-8b15-4800-9982-df0c3aa099c8-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:30 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f Sep 09 14:58:30 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf" returned: 0 in 0.274s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info Sep 09 14:58:30 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8be15c22-991a-4d07-be9a-89aeaa1ddce3" returned: 0 in 0.312s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-8be15c22-991a-4d07-be9a-89aeaa1ddce3" released by "delete_volume" :: held 0.857s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created reservations ['81dd8939-0b0a-4876-892e-e4389d9a5f3f', '8e0e354d-2368-447d-9aa2-656b67b342d0', 'b87efacf-d7e0-49b4-83ac-56bbdb071f28', 'f3c769e5-6b5c-4d0d-9e78-5074da2a2d4a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:30 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f" returned: 0 in 0.431s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f Sep 09 14:58:30 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info" returned: 0 in 0.310s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info is being set with open permissions: ugo+rw Sep 09 14:58:30 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:30 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-60a93766-61d6-4d6e-9f40-48b866ba6c67-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:30 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info Sep 09 14:58:30 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-60a93766-61d6-4d6e-9f40-48b866ba6c67-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-quobyte-60a93766-61d6-4d6e-9f40-48b866ba6c67" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-60a93766-61d6-4d6e-9f40-48b866ba6c67" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a67433-1832-4d2d-b411-32cfc0a123a8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-bebcf76b-6517-4a6a-939f-e91dbae7061f" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-quobyte-bebcf76b-6517-4a6a-939f-e91dbae7061f" released by "delete_volume" :: held 0.852s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Created reservations ['d54a5c78-3c6a-471a-980a-4341cd5c22c9', '25641d17-922f-4c7f-b7a8-4b787233196f', 'c59c4c88-e202-4b98-bd82-178aaeca9813', 'a1e73127-cf39-42eb-90ce-74a1c1c6442f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:30 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 Sep 09 14:58:30 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.info" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.872s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72042a9-c6a0-4228-9c7d-b2373e374eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee394595d6a7440e98d996ad44fa6b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:23Z,use_quota=True,user_id='2062884e76e44c33aa86077c2a081245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8ce68cd-88f0-4991-ad04-0358476f9d2f),volume_type_id=b8ce68cd-88f0-4991-ad04-0358476f9d2f)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Creating volume b72042a9-c6a0-4228-9c7d-b2373e374eb8 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:30 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:30 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 1073741824 Sep 09 14:58:30 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Deleted volume successfully. Sep 09 14:58:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a536667d-5039-4b92-8d6e-23fd6bcfdfb0 tempest-ProjectReaderTests-803268646 None] Create snapshot completed successfully Sep 09 14:58:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f8d93426-ac83-432d-81dd-835944d09633 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-8be15c22-991a-4d07-be9a-89aeaa1ddce3-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:31 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:31 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:31 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67" returned: 0 in 0.510s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:31 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67 Sep 09 14:58:31 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:31 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.352s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Deleted volume successfully. Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b0079f4c-154c-47bd-ab51-f363f2910549 tempest-CreateVolumesFromImageTest-1525675244 None] Lock "cinder-bebcf76b-6517-4a6a-939f-e91dbae7061f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:31 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 1073741824" returned: 0 in 0.632s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:31 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-60a93766-61d6-4d6e-9f40-48b866ba6c67" returned: 0 in 0.336s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-b7c3ab77-f705-4592-807a-d2c634a56fbf-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-60a93766-61d6-4d6e-9f40-48b866ba6c67" released by "delete_volume" :: held 0.915s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Lock "cinder-b7c3ab77-f705-4592-807a-d2c634a56fbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-b7c3ab77-f705-4592-807a-d2c634a56fbf" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:31 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 Sep 09 14:58:31 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-b7c3ab77-f705-4592-807a-d2c634a56fbf" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Deleting offline snapshot b7c3ab77-f705-4592-807a-d2c634a56fbf of volume 1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] snapshot_file for this snap is: volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de4255-7f01-4ae9-b6a1-36b9dbe3ce67]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created reservations ['f0e75ee3-cb5b-4e50-95c0-cca3333e4c68', '06fea998-ebd5-417b-95ee-00569e70af1f', 'afd9f2f6-a74f-456e-b7f6-fbfb8c6f80c3', 'd294a4c6-502c-4fef-9cd2-d78255bc8280'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:31 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:31 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:31 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf Sep 09 14:58:31 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:31 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8" returned: 0 in 0.339s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Attempting download of ec807b07-6080-4684-bb01-7010595fa579 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec807b07-6080-4684-bb01-7010595fa579', 'metadata': {}}])) to volume b72042a9-c6a0-4228-9c7d-b2373e374eb8. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec294d-737d-4284-a365-87ecfbf2c9c8]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:32 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.341s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:32 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Deleted volume successfully. Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-3b014084-e9cf-40b2-9dd2-413579ede24b tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-60a93766-61d6-4d6e-9f40-48b866ba6c67-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:32 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj Sep 09 14:58:32 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:32 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf" returned: 0 in 0.544s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac7a4fd-52b7-417a-bee3-3bf520331667]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:32 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b Sep 09 14:58:32 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:32 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj" returned: 0 in 0.451s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:32 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj Sep 09 14:58:32 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:32 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" returned: 0 in 0.466s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:32 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf Sep 09 14:58:32 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-quobyte-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:32 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj" returned: 1 in 0.451s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec807b07-6080-4684-bb01-7010595fa579_aqayvcfj' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c58339-f56c-47ac-9602-00915bdbd3db]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9" acquired by "delete_volume" :: waited 0.041s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c386300-6497-4aa9-b7d2-2232b930b1f7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:33 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD Sep 09 14:58:33 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:33 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 Sep 09 14:58:33 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:33 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf" returned: 0 in 0.441s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:33 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf Sep 09 14:58:33 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:33 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:33 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9" returned: 0 in 0.454s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:33 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b.b7c3ab77-f705-4592-807a-d2c634a56fbf" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9 Sep 09 14:58:33 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:33 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD Sep 09 14:58:33 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-b7c3ab77-f705-4592-807a-d2c634a56fbf" released by "_delete_snapshot" :: held 1.895s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" released by "delete_snapshot" :: held 1.952s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Created reservations ['54d98058-7fad-4e92-b749-560fdd5ef308', '7605ca57-6431-430a-94a7-f9440ca9de7f', 'c4ab8c40-095a-4460-8fee-965976ec3938', 'a4fef6e7-cd2f-4117-adda-5cb038c9bc73'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Delete snapshot completed successfully. Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-63e8d062-8060-44da-b943-8c6d679d2a67 tempest-ProjectReaderTests-803268646 None] Lock "cinder-b7c3ab77-f705-4592-807a-d2c634a56fbf-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:33 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] ec807b07-6080-4684-bb01-7010595fa579 was raw, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9" released by "delete_volume" :: held 0.833s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:33 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 Sep 09 14:58:33 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:33 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created reservations ['19ab1d63-f51a-420b-9d93-d94c2596dc70', '366dafeb-1a0e-4d45-b166-19e35fff10f6', '02a2c3d8-d3db-459d-8866-6e2b3ffb01b9', '808805e3-3b13-4b2e-83d0-ba87b4cbaf2f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:34 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:34 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-quobyte-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55de9bb-c723-44df-b690-5d814ce1660e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:34 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.344s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:34 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Deleted volume successfully. Sep 09 14:58:34 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b Sep 09 14:58:34 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7cf5755a-bb76-4ca4-b08b-ef8bcebac800 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-91b59f0d-06e7-40cd-a9ea-563c0af9b8b9-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:34 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8" returned: 0 in 0.626s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec807b07-6080-4684-bb01-7010595fa579_uyszgplqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:58:34 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:34 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 1G Sep 09 14:58:34 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:34 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b" returned: 0 in 0.461s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:34 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b Sep 09 14:58:34 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-1d3519f1-e1a6-42ee-9611-012e0f0cc83b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Lock "cinder-1d3519f1-e1a6-42ee-9611-012e0f0cc83b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:34 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 1G" returned: 0 in 0.456s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Downloaded image ec807b07-6080-4684-bb01-7010595fa579 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec807b07-6080-4684-bb01-7010595fa579', 'metadata': {}}])) to volume b72042a9-c6a0-4228-9c7d-b2373e374eb8 successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Temporary image ec807b07-6080-4684-bb01-7010595fa579 for user 2062884e76e44c33aa86077c2a081245 is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Marking volume b72042a9-c6a0-4228-9c7d-b2373e374eb8 as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Copying metadata from image ec807b07-6080-4684-bb01-7010595fa579 to b72042a9-c6a0-4228-9c7d-b2373e374eb8. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Creating volume glance metadata for volume b72042a9-c6a0-4228-9c7d-b2373e374eb8 backed by image ec807b07-6080-4684-bb01-7010595fa579 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ec807b07-6080-4684-bb01-7010595fa579', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ed01cc031c3f08c5172c2ec6c9b00eee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:58:34 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (d4c3166a-a6d1-4a8a-ad9e-4a3fee58f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b1d3b9-766d-449f-809c-ea38178c1b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" acquired by "delete_volume" :: waited 0.063s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:35 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b1d3b9-766d-449f-809c-ea38178c1b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725527618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f52a20-6d87-481a-9462-105caeb6c687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:35Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1e1641-cef9-4f82-bea8-1324ce328adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1e1641-cef9-4f82-bea8-1324ce328adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8836e59-e96f-4bd0-8d81-dd954a509f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8836e59-e96f-4bd0-8d81-dd954a509f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f52a20-6d87-481a-9462-105caeb6c687', 'volume_name': 'volume-94f52a20-6d87-481a-9462-105caeb6c687', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b083c9-2f08-4866-a5f1-acb1b18f034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b083c9-2f08-4866-a5f1-acb1b18f034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6b76ae-6495-4654-a3f3-54b6da0d4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:35 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume 94f52a20-6d87-481a-9462-105caeb6c687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f52a20-6d87-481a-9462-105caeb6c687', 'volume_size': 1} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725527618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f52a20-6d87-481a-9462-105caeb6c687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:35Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating volume 94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:35 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[874e60d3-d0bf-411b-9b4f-7e6dda14cc75]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:35 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 1073741824 Sep 09 14:58:35 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b" released by "delete_volume" :: held 0.945s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a08f23-cccd-4976-a579-caeec8615a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8', 'volume_size': 1, 'image_id': 'ec807b07-6080-4684-bb01-7010595fa579', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec807b07-6080-4684-bb01-7010595fa579', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed01cc031c3f08c5172c2ec6c9b00eee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee394595d6a7440e98d996ad44fa6b6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eb58308dd51a1b0fe5591a4ddb54d2fd8346a7e79962d3a989dc01148b2e68fcb8a2befd5304a92a5de4b391d62c883b915b862c5aee4556317f520439e1900', 'id': 'ec807b07-6080-4684-bb01-7010595fa579', 'created_at': datetime.datetime(2026, 9, 9, 12, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 58, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec807b07-6080-4684-bb01-7010595fa579/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef076b1-1f3f-45f9-873a-af4680e4dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:35 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Volume volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 (b72042a9-c6a0-4228-9c7d-b2373e374eb8): created successfully Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef076b1-1f3f-45f9-873a-af4680e4dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Flow 'volume_create_manager' (96d7e1e9-6cdc-4eb1-813f-5d3371ed1951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created reservations ['02233512-7518-4fa2-96eb-36760f06e67a', '413ffcf2-975a-499d-91e6-377c4983db8c', '47f2b6fc-0631-47b8-a5a1-33fbd1641fc2', 'a0df4fed-ce30-4c0f-9898-cbc04475e71b'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:35 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b Sep 09 14:58:35 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2bbc80b7-c66a-4999-bb28-fc60e74b67fb tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Created volume successfully. Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:35 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:35 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:35 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" returned: 0 in 0.456s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:35 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b Sep 09 14:58:35 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Acquiring lock "cinder-b72042a9-c6a0-4228-9c7d-b2373e374eb8-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "cinder-b72042a9-c6a0-4228-9c7d-b2373e374eb8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:35 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 1073741824" returned: 0 in 0.561s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:35 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Acquiring lock "cinder-quobyte-b72042a9-c6a0-4228-9c7d-b2373e374eb8" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Deleted volume successfully. Sep 09 14:58:35 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 Sep 09 14:58:35 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "cinder-quobyte-b72042a9-c6a0-4228-9c7d-b2373e374eb8" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-4a4a64ee-5f3b-4f16-9fc1-16ba082316fc tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-9e6fd05e-be0c-4af7-ab23-4f27b2448f5b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[006a1608-302f-4577-9a5a-3624d231fce0]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:35 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" returned: 0 in 0.330s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:35 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 Sep 09 14:58:35 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-1d3519f1-e1a6-42ee-9611-012e0f0cc83b" released by "delete_volume" :: held 0.913s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Created reservations ['4556e2c8-7ee3-43f3-8a85-12c795cc7137', '820eb8f2-efbe-490f-aa13-38a32816e73e', 'e2a47255-917f-447d-b80e-2c4045ddd3e8', '0e5fc5bd-282e-425d-a55b-ca9c8981177c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:36 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6b76ae-6495-4654-a3f3-54b6da0d4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f52a20-6d87-481a-9462-105caeb6c687', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9c7e21-2bcf-494b-8c1e-940178d579e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:36 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume volume-94f52a20-6d87-481a-9462-105caeb6c687 (94f52a20-6d87-481a-9462-105caeb6c687): created successfully Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9c7e21-2bcf-494b-8c1e-940178d579e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (d4c3166a-a6d1-4a8a-ad9e-4a3fee58f34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:36 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c6d864f9-3a44-4bde-b67b-2b88425f9e5f tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created volume successfully. Sep 09 14:58:36 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:36 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:36 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8" returned: 0 in 0.434s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:36 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8 Sep 09 14:58:36 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:36 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.266s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:36 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Deleted volume successfully. Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-93d210e1-36dd-4f3e-b48a-9dfc2ed3d404 tempest-ProjectReaderTests-803268646 None] Lock "cinder-1d3519f1-e1a6-42ee-9611-012e0f0cc83b-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-8e6452e4-eac3-4337-ae95-83d24b4b9fdc-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-8e6452e4-eac3-4337-ae95-83d24b4b9fdc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:36 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b72042a9-c6a0-4228-9c7d-b2373e374eb8" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "cinder-quobyte-b72042a9-c6a0-4228-9c7d-b2373e374eb8" released by "delete_volume" :: held 0.744s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-quobyte-8e6452e4-eac3-4337-ae95-83d24b4b9fdc" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-8e6452e4-eac3-4337-ae95-83d24b4b9fdc" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c376d2b-425e-465c-9b6d-6f8adfb4ad9c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Created reservations ['9f1a8b80-1c29-4659-b76c-024c321c7095', '63dde938-310d-4ab0-83d9-328bbc645c7a', 'bc7bf931-e0ac-4ab3-b27a-d9658d08f15e', '8399f154-6d66-4940-a4fb-ee71c9d57e2e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:36 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc Sep 09 14:58:36 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:36 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:36 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:36 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:36 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc" returned: 0 in 0.431s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Deleted volume successfully. Sep 09 14:58:37 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc Sep 09 14:58:37 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-0399d51f-4317-43ef-89cf-734eec6d2b66 tempest-VolumeAndVolumeTypeFromImageTest-839675980 None] Lock "cinder-b72042a9-c6a0-4228-9c7d-b2373e374eb8-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:37 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8e6452e4-eac3-4337-ae95-83d24b4b9fdc" returned: 0 in 0.531s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating offline snapshot 5a0368ce-a487-4959-9483-b48b8784bde2 of volume 94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-8e6452e4-eac3-4337-ae95-83d24b4b9fdc" released by "delete_volume" :: held 1.018s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709c55e-a752-4b20-a20e-1e1365cadea2]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created reservations ['43d825ed-52de-4615-8d8a-190149f813ad', 'f8f5e164-55aa-4268-9870-1d909892bc3a', '1b6cbe2b-3838-419e-a870-dfe971e17842', '0df35995-7f44-40c4-beb2-79176c67c48f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:37 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 Sep 09 14:58:37 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:37 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:37 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:38 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (b7706900-ad48-40ce-a50e-5073fc636886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6f1301-8438-4a43-8c66-182d2a4f794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:38 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.329s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687" returned: 0 in 0.539s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:38 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Deleted volume successfully. Sep 09 14:58:38 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 1G Sep 09 14:58:38 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6f1301-8438-4a43-8c66-182d2a4f794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164438729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503fc601-f783-4c44-9c61-faf0de7b2b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:38Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3314d1a-bfa2-4150-a2e8-7d37264f711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3314d1a-bfa2-4150-a2e8-7d37264f711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e31b7e-4cc6-4853-9552-f0a28833a3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e31b7e-4cc6-4853-9552-f0a28833a3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503fc601-f783-4c44-9c61-faf0de7b2b9a', 'volume_name': 'volume-503fc601-f783-4c44-9c61-faf0de7b2b9a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65b79e9-f763-4d03-9f5d-e6f9be6c435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65b79e9-f763-4d03-9f5d-e6f9be6c435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5aecf-3069-4d1f-8408-e3c65ccc8835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Volume 503fc601-f783-4c44-9c61-faf0de7b2b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503fc601-f783-4c44-9c61-faf0de7b2b9a', 'volume_size': 1} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbec9fa8-b954-495f-b0b2-2e7b27e561c5 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-8e6452e4-eac3-4337-ae95-83d24b4b9fdc-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:38 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 1G" returned: 0 in 0.471s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f52a20-6d87-481a-9462-105caeb6c687 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:38 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f52a20-6d87-481a-9462-105caeb6c687 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 Sep 09 14:58:38 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-0bb6b194-8bc7-4542-aea9-ff6dc12b945e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-0bb6b194-8bc7-4542-aea9-ff6dc12b945e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "cinder-quobyte-0bb6b194-8bc7-4542-aea9-ff6dc12b945e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-0bb6b194-8bc7-4542-aea9-ff6dc12b945e" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd22c6-d039-4ec1-939b-5a337582b02f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:38 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f52a20-6d87-481a-9462-105caeb6c687 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2" returned: 0 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:38 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 is being set with open permissions: ugo+rw Sep 09 14:58:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:38 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e Sep 09 14:58:38 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:38 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 Sep 09 14:58:38 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:39 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2" returned: 0 in 0.304s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:39 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:39 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e Sep 09 14:58:39 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:39 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info Sep 09 14:58:39 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:39 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-0bb6b194-8bc7-4542-aea9-ff6dc12b945e" returned: 0 in 0.290s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:39 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-quobyte-0bb6b194-8bc7-4542-aea9-ff6dc12b945e" released by "delete_volume" :: held 0.775s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:39 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info is being set with open permissions: ugo+rw Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:39 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info Sep 09 14:58:39 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Created reservations ['96d2810c-8d91-4591-95e5-ebe6b86a049c', 'd4c275a2-6bfa-444e-9e2c-4cd575a1d40d', 'a8f1c6a2-70ad-4383-a93a-e48730541bec', '4ad4ecb1-9ee0-4fb7-b5d5-b87675198919'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:39 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:39 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:39 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.info" returned: 0 in 0.286s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164438729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503fc601-f783-4c44-9c61-faf0de7b2b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:38Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Creating volume 503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:39 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:39 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a 1073741824 Sep 09 14:58:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-cc466f83-5b62-4fb7-8303-13f98b5d5091 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Create snapshot completed successfully Sep 09 14:58:39 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Deleted volume successfully. Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ddf9214c-83a6-4514-aaa6-839a3df20233 tempest-CreateVolumesFromSourceVolumeTest-662206411 None] Lock "cinder-0bb6b194-8bc7-4542-aea9-ff6dc12b945e-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:39 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:40 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a 1073741824" returned: 0 in 0.607s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:40 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a Sep 09 14:58:40 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:40 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5aecf-3069-4d1f-8408-e3c65ccc8835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503fc601-f783-4c44-9c61-faf0de7b2b9a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16aef88-e797-4ef6-ab3b-b200b6cc138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:40 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Volume volume-503fc601-f783-4c44-9c61-faf0de7b2b9a (503fc601-f783-4c44-9c61-faf0de7b2b9a): created successfully Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16aef88-e797-4ef6-ab3b-b200b6cc138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:40 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (b7706900-ad48-40ce-a50e-5073fc636886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:40 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d82fa64c-8a97-4a65-b4fc-3f60628bd569 tempest-ProjectReaderTests-803268646 None] Created volume successfully. Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (e5ed40b9-0f0b-42b6-9554-40720a05c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686415aa-4520-4e26-9f77-8230ae386778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686415aa-4520-4e26-9f77-8230ae386778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374200967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad4ddfb-bef1-4237-9fd9-3755b4951d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:41Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d7ce4c-3dbf-46e1-9154-9ea7ec25a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d7ce4c-3dbf-46e1-9154-9ea7ec25a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca28cdd-8a60-4563-b578-78a7e0329951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca28cdd-8a60-4563-b578-78a7e0329951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad4ddfb-bef1-4237-9fd9-3755b4951d40', 'volume_name': 'volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e71b960-1921-4248-b25b-c8aebfee57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e71b960-1921-4248-b25b-c8aebfee57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4408f0b6-c0dd-4769-ad99-6377a5a1142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:41 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume dad4ddfb-bef1-4237-9fd9-3755b4951d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40', 'volume_size': 1} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374200967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad4ddfb-bef1-4237-9fd9-3755b4951d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:41Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating volume dad4ddfb-bef1-4237-9fd9-3755b4951d40 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:41 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:41 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 1073741824 Sep 09 14:58:41 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:42 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 1073741824" returned: 0 in 0.734s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (3a3d093f-5c37-4097-9914-d6c4e695ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052629b6-fb45-4fce-98c4-e79ca9193675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052629b6-fb45-4fce-98c4-e79ca9193675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300498003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b2b729-0919-4fe9-9340-1986afa82962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:42Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921e0b62-d8ec-400c-99f1-4061a3ce7573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921e0b62-d8ec-400c-99f1-4061a3ce7573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0302a10a-0b0c-4d06-b08d-432aa816fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0302a10a-0b0c-4d06-b08d-432aa816fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b2b729-0919-4fe9-9340-1986afa82962', 'volume_name': 'volume-c0b2b729-0919-4fe9-9340-1986afa82962', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f750e30e-485c-4bd7-964d-bb1dc028f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f750e30e-485c-4bd7-964d-bb1dc028f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d34027-2fe2-468c-a2cd-dd89e0982aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume c0b2b729-0919-4fe9-9340-1986afa82962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b2b729-0919-4fe9-9340-1986afa82962', 'volume_size': 1} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:42 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 Sep 09 14:58:42 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (f5569614-f29f-4c6e-ae0b-c8925d21db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ec6106-deb8-4703-8f98-3f4a88789d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40" returned: 0 in 0.342s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.556s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ec6106-deb8-4703-8f98-3f4a88789d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733624883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f0214f-28d6-4081-bcbd-4073e307afcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:43Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b937620-34cf-4ad3-93f0-3fee35d32b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b937620-34cf-4ad3-93f0-3fee35d32b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302286e7-068e-4e9e-b542-22a830404eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302286e7-068e-4e9e-b542-22a830404eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f0214f-28d6-4081-bcbd-4073e307afcf', 'volume_name': 'volume-81f0214f-28d6-4081-bcbd-4073e307afcf', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11819358-94df-4e21-a8f3-f00764d0c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11819358-94df-4e21-a8f3-f00764d0c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d4c2cb-505b-41b6-893e-daa81e58b7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume 81f0214f-28d6-4081-bcbd-4073e307afcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f0214f-28d6-4081-bcbd-4073e307afcf', 'volume_size': 1} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Creating offline snapshot 93201c46-2ccf-4d0a-b312-c6e627e95c39 of volume 503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4408f0b6-c0dd-4769-ad99-6377a5a1142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1b41ca-8bcf-489c-ba17-fd839e4fe9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b291d3-45ad-468c-b0f8-14f22d820f3e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 (dad4ddfb-bef1-4237-9fd9-3755b4951d40): created successfully Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1b41ca-8bcf-489c-ba17-fd839e4fe9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (e5ed40b9-0f0b-42b6-9554-40720a05c228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a22d6ff8-3ef4-4318-9fea-f2eba88a559c tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created volume successfully. Sep 09 14:58:43 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a Sep 09 14:58:43 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (260d1a5c-11d3-4ff8-ba34-396072c94fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5226d4-bf05-4960-a9f0-5bcd31564a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5226d4-bf05-4960-a9f0-5bcd31564a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1708987298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aba7743-4d66-4cbd-b041-2111102d55a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:43Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cdfaa-5ff0-4264-99c8-4479d414f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cdfaa-5ff0-4264-99c8-4479d414f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb9f0a7-44f2-4e93-8ce7-1fa54532a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb9f0a7-44f2-4e93-8ce7-1fa54532a14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aba7743-4d66-4cbd-b041-2111102d55a1', 'volume_name': 'volume-4aba7743-4d66-4cbd-b041-2111102d55a1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa12166-c0f7-457a-8993-c8dc0acccb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa12166-c0f7-457a-8993-c8dc0acccb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2252ad-970a-42cf-83d1-1e120b4f6ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume 4aba7743-4d66-4cbd-b041-2111102d55a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aba7743-4d66-4cbd-b041-2111102d55a1', 'volume_size': 1} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a" returned: 0 in 0.567s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:43 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:43 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 1G Sep 09 14:58:43 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (d2f0c0cb-faf0-4415-88d1-37817c35e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf9ae3-10a9-4dee-9283-21abb10115a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf9ae3-10a9-4dee-9283-21abb10115a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025731587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0406ec-e1c4-4ace-858f-4deb9cd51ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:43Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49844a14-8646-4f00-a599-1c4885ef0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49844a14-8646-4f00-a599-1c4885ef0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e5ecba-8656-4985-95c1-2d52c951b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e5ecba-8656-4985-95c1-2d52c951b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0406ec-e1c4-4ace-858f-4deb9cd51ce5', 'volume_name': 'volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22c163a-b139-42a1-9173-b347cc018e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22c163a-b139-42a1-9173-b347cc018e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c61ece-9c3c-481e-918a-b94239e8eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume 2f0406ec-e1c4-4ace-858f-4deb9cd51ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5', 'volume_size': 1} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:43 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 1G" returned: 0 in 0.498s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503fc601-f783-4c44-9c61-faf0de7b2b9a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:43 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503fc601-f783-4c44-9c61-faf0de7b2b9a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 Sep 09 14:58:43 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:44 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503fc601-f783-4c44-9c61-faf0de7b2b9a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39" returned: 0 in 0.330s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:44 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 is being set with open permissions: ugo+rw Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:44 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 Sep 09 14:58:44 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (f24cb59b-bcd6-4868-9564-05ce6c0c5202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175a1dfe-9cf1-4baf-bdbc-d845c4e67b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175a1dfe-9cf1-4baf-bdbc-d845c4e67b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44949225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f972a5-b56b-4709-ab1c-49b6c8625eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:44Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be575136-fd4f-4583-8b98-1ae852d5bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be575136-fd4f-4583-8b98-1ae852d5bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:44 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9588fee9-636b-4b04-acd2-a5d9da834da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9588fee9-636b-4b04-acd2-a5d9da834da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f972a5-b56b-4709-ab1c-49b6c8625eed', 'volume_name': 'volume-20f972a5-b56b-4709-ab1c-49b6c8625eed', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6d878c-36a9-4e41-91f3-57bee400dfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6d878c-36a9-4e41-91f3-57bee400dfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73aa41dc-ecd2-4c80-869a-21a6c7947750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Volume 20f972a5-b56b-4709-ab1c-49b6c8625eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f972a5-b56b-4709-ab1c-49b6c8625eed', 'volume_size': 1} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39" returned: 0 in 0.281s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:44 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info Sep 09 14:58:44 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:44 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:44 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info is being set with open permissions: ugo+rw Sep 09 14:58:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:44 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info Sep 09 14:58:44 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:45 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.info" returned: 0 in 0.243s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300498003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b2b729-0919-4fe9-9340-1986afa82962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:42Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating volume c0b2b729-0919-4fe9-9340-1986afa82962 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:45 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:45 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 1073741824 Sep 09 14:58:45 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:45 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-4da75d53-d1fd-4162-a5be-410e7bed5f6c tempest-ProjectReaderTests-803268646 None] Create snapshot completed successfully Sep 09 14:58:45 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 1073741824" returned: 0 in 0.449s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:45 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 Sep 09 14:58:45 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:45 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962" returned: 0 in 0.250s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.025s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733624883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f0214f-28d6-4081-bcbd-4073e307afcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:43Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating volume 81f0214f-28d6-4081-bcbd-4073e307afcf {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:45 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:45 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf 1073741824 Sep 09 14:58:45 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d34027-2fe2-468c-a2cd-dd89e0982aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b2b729-0919-4fe9-9340-1986afa82962', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c9087d-bc05-4480-9b19-50cd9e71cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:45 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume volume-c0b2b729-0919-4fe9-9340-1986afa82962 (c0b2b729-0919-4fe9-9340-1986afa82962): created successfully Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c9087d-bc05-4480-9b19-50cd9e71cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (3a3d093f-5c37-4097-9914-d6c4e695ad69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-93201c46-2ccf-4d0a-b312-c6e627e95c39-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:45 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ddd3c4c4-c8c2-4825-a6db-3c711546704a tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created volume successfully. Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Lock "cinder-93201c46-2ccf-4d0a-b312-c6e627e95c39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-503fc601-f783-4c44-9c61-faf0de7b2b9a" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-503fc601-f783-4c44-9c61-faf0de7b2b9a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-93201c46-2ccf-4d0a-b312-c6e627e95c39" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-93201c46-2ccf-4d0a-b312-c6e627e95c39" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Deleting offline snapshot 93201c46-2ccf-4d0a-b312-c6e627e95c39 of volume 503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] snapshot_file for this snap is: volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[35efdbd0-9b3b-42c8-b13a-161d683996b8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:46 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 Sep 09 14:58:46 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:46 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf 1073741824" returned: 0 in 0.508s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:46 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf Sep 09 14:58:46 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:46 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39" returned: 0 in 0.416s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503fc601-f783-4c44-9c61-faf0de7b2b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae4476-b803-4922-9388-5ffae3d86555]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:46 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a Sep 09 14:58:46 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:46 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf" returned: 0 in 0.311s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.485s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1708987298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aba7743-4d66-4cbd-b041-2111102d55a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:43Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating volume 4aba7743-4d66-4cbd-b041-2111102d55a1 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:46 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d4c2cb-505b-41b6-893e-daa81e58b7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f0214f-28d6-4081-bcbd-4073e307afcf', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3883519-bf59-484e-bf36-0f51438f123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:46 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 1073741824 Sep 09 14:58:46 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume volume-81f0214f-28d6-4081-bcbd-4073e307afcf (81f0214f-28d6-4081-bcbd-4073e307afcf): created successfully Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3883519-bf59-484e-bf36-0f51438f123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (f5569614-f29f-4c6e-ae0b-c8925d21db49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2f6650fa-9b66-4591-affa-05507eb10d27 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created volume successfully. Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Flow 'volume_create_manager' (c3661c53-d053-4a88-ac6a-b09a64568cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d925a-bbbe-4fe0-a8ca-563ccc4fdef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d925a-bbbe-4fe0-a8ca-563ccc4fdef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2ca7ae2a02451bb291135029f4ecf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:47Z,use_quota=True,user_id='01b8fe6bee3f4e748f8549075ce2481f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d1e86-f3b3-4f0a-90a3-f1c8ab2f01e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:46 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d1e86-f3b3-4f0a-90a3-f1c8ab2f01e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b9b411-f8c3-45b8-9d67-c42ad350ee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG cinder.image.glance [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Creating Keystone auth plugin from conf {{(pid=87325) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a" returned: 0 in 0.476s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:47 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 Sep 09 14:58:47 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b9b411-f8c3-45b8-9d67-c42ad350ee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd', 'volume_name': 'volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd', 'volume_size': 1, 'image_id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c744e4cb0d99bd8def244a7caef2012', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb2ca7ae2a02451bb291135029f4ecf5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72935f607bf73d3f224c5f720c3c445f6e89f647283a4a24987165c492509844b29fd77df2502acc2c0656b3699f33514bf6b7ae50bfa99278ec70f236bcaf75', 'id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'created_at': datetime.datetime(2026, 9, 9, 12, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 58, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447/file', 'properties': {}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728e003f-1401-4a15-b27e-1ba82694e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728e003f-1401-4a15-b27e-1ba82694e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ccb1a1-7a56-428c-88c3-1cb5491ede54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Volume 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd', 'volume_size': 1, 'image_id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c744e4cb0d99bd8def244a7caef2012', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb2ca7ae2a02451bb291135029f4ecf5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72935f607bf73d3f224c5f720c3c445f6e89f647283a4a24987165c492509844b29fd77df2502acc2c0656b3699f33514bf6b7ae50bfa99278ec70f236bcaf75', 'id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'created_at': datetime.datetime(2026, 9, 9, 12, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 58, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447/file', 'properties': {}}, 'image_service': } Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Trying to clone 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd from image b4f23094-ddb2-4f9d-9606-ac0affe9e447 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'metadata': {}}]). {{(pid=87325) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 14:58:47 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 1073741824" returned: 0 in 0.549s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 14:58:47 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Image download 0.00 MB at 0.00 MB/s Sep 09 14:58:47 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 Sep 09 14:58:47 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:47 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39" returned: 0 in 0.414s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:47 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39 Sep 09 14:58:47 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855d157-679d-4756-a3f7-bd7ce203c1e6]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:47 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD Sep 09 14:58:47 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:47 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1" returned: 0 in 0.287s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.037s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025731587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0406ec-e1c4-4ace-858f-4deb9cd51ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21805380a50d43f8b43dc4adec258373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:43Z,use_quota=True,user_id='23c57389253c4f1aa4a56be77ac3f475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Creating volume 2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:47 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:47 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2252ad-970a-42cf-83d1-1e120b4f6ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aba7743-4d66-4cbd-b041-2111102d55a1', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:47 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 1073741824 Sep 09 14:58:47 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f01c0e4-a8d5-4612-8a13-0a168efd5da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a.93201c46-2ccf-4d0a-b312-c6e627e95c39" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-93201c46-2ccf-4d0a-b312-c6e627e95c39" released by "_delete_snapshot" :: held 1.708s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume volume-4aba7743-4d66-4cbd-b041-2111102d55a1 (4aba7743-4d66-4cbd-b041-2111102d55a1): created successfully Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f01c0e4-a8d5-4612-8a13-0a168efd5da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (260d1a5c-11d3-4ff8-ba34-396072c94fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-503fc601-f783-4c44-9c61-faf0de7b2b9a" released by "delete_snapshot" :: held 1.745s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5f193169-568b-455c-bf2f-9434f6daa8f4 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created volume successfully. Sep 09 14:58:47 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Created reservations ['8a297b17-e9d8-4d34-854d-92a3420d81e5', '4e3ee5ac-d3f6-4fec-97f7-0244329f7b21', 'a0e1e809-87f3-4b6b-8e6d-696a15690155', '097728f6-fb1d-4e1e-9114-54a4f90c674a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Delete snapshot completed successfully. Sep 09 14:58:47 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2c87d6bf-141b-4f78-af6a-c23674f61c64 tempest-ProjectReaderTests-803268646 None] Lock "cinder-93201c46-2ccf-4d0a-b312-c6e627e95c39-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:47 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD Sep 09 14:58:47 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-503fc601-f783-4c44-9c61-faf0de7b2b9a-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-503fc601-f783-4c44-9c61-faf0de7b2b9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:48 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 1073741824" returned: 0 in 0.519s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-503fc601-f783-4c44-9c61-faf0de7b2b9a" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-503fc601-f783-4c44-9c61-faf0de7b2b9a" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:48 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD" returned: 1 in 0.427s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Temporary image b4f23094-ddb2-4f9d-9606-ac0affe9e447 is fetched for user 01b8fe6bee3f4e748f8549075ce2481f. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd3c97-c389-4b22-bce5-e8c0bb9b3fd9]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:48 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 Sep 09 14:58:48 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0770cb5c-67c9-4779-9842-1c75d0d552f1]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:48 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a Sep 09 14:58:48 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD Sep 09 14:58:48 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.981s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44949225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f972a5-b56b-4709-ab1c-49b6c8625eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:44Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Creating volume 20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:48 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c61ece-9c3c-481e-918a-b94239e8eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:48 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed 1073741824 Sep 09 14:58:48 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb63fc3-a057-4a88-9305-15f0905ebaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:48 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Volume volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 (2f0406ec-e1c4-4ace-858f-4deb9cd51ce5): created successfully Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb63fc3-a057-4a88-9305-15f0905ebaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Flow 'volume_create_manager' (d2f0c0cb-faf0-4415-88d1-37817c35e116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6eeb71c4-68f2-4c76-93a5-5ce146a9da81 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created volume successfully. Sep 09 14:58:48 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:48 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a Sep 09 14:58:48 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD Sep 09 14:58:48 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:48 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-503fc601-f783-4c44-9c61-faf0de7b2b9a" returned: 0 in 0.287s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-503fc601-f783-4c44-9c61-faf0de7b2b9a" released by "delete_volume" :: held 0.782s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:48 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:48 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed 1073741824" returned: 0 in 0.472s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Created reservations ['0a89461b-9771-46cc-99cc-eeee2e42d11f', '01a460ce-f1d6-4c42-b2c0-949825e4ad59', '10c79a30-7c7f-4516-8972-b928d834f065', 'c48dc83f-34b0-4bc1-bc0a-1493bf1cda17'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:49 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed Sep 09 14:58:49 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:49 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:49 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5" acquired by "delete_volume" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8594a60-e659-4713-aad1-0a692a360a7f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:49 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed" returned: 0 in 0.312s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2ca7ae2a02451bb291135029f4ecf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:47Z,use_quota=True,user_id='01b8fe6bee3f4e748f8549075ce2481f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Creating volume 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:49 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73aa41dc-ecd2-4c80-869a-21a6c7947750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f972a5-b56b-4709-ab1c-49b6c8625eed', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1888c877-d2c6-4664-aa03-f31aa92702bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:49 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd 1073741824 Sep 09 14:58:49 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:49 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Volume volume-20f972a5-b56b-4709-ab1c-49b6c8625eed (20f972a5-b56b-4709-ab1c-49b6c8625eed): created successfully Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1888c877-d2c6-4664-aa03-f31aa92702bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (f24cb59b-bcd6-4868-9564-05ce6c0c5202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:49 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.312s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:49 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 Sep 09 14:58:49 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-444cfbdd-a42b-4ba3-a970-8036b4a3b511 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:58:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Deleted volume successfully. Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8e5de798-7ab4-4793-9663-c615afb868a3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-503fc601-f783-4c44-9c61-faf0de7b2b9a-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:49 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5" returned: 0 in 0.480s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:49 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5 Sep 09 14:58:49 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (97ecbc96-4a7a-449b-b510-6bb69fac8765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d8be54-fef3-4d99-9765-0ad291e98b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:49 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd 1073741824" returned: 0 in 0.582s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d8be54-fef3-4d99-9765-0ad291e98b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1333026461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df20f94-9234-4976-96eb-29c82ac92398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:50Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711a25de-4914-4e9f-8047-66469c2601c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711a25de-4914-4e9f-8047-66469c2601c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403fc136-d7fb-418c-b4f3-e417bea5b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403fc136-d7fb-418c-b4f3-e417bea5b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df20f94-9234-4976-96eb-29c82ac92398', 'volume_name': 'volume-6df20f94-9234-4976-96eb-29c82ac92398', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f919a1e1-2bc2-42a9-9042-4e28249c5056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f919a1e1-2bc2-42a9-9042-4e28249c5056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9663ff-48ac-4c82-af9b-a60243368621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Volume 6df20f94-9234-4976-96eb-29c82ac92398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df20f94-9234-4976-96eb-29c82ac92398', 'volume_size': 1} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd Sep 09 14:58:50 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:50 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5" returned: 0 in 0.320s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5" released by "delete_volume" :: held 0.851s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['e0564d40-8bc5-4656-be78-3ba4e825270a', '31ed3708-785e-4e1c-847e-b1dece7b97d2', '06ff702d-5ff3-46e0-8cfb-fc6d774581aa', '57b689bf-c48c-478c-9f0e-0bfaa73fb6cb'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:50 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:50 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" returned: 0 in 0.296s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1333026461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df20f94-9234-4976-96eb-29c82ac92398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:50Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Creating volume 6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:50 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 1073741824 Sep 09 14:58:50 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-4aba7743-4d66-4cbd-b041-2111102d55a1-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Attempting download of b4f23094-ddb2-4f9d-9606-ac0affe9e447 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'metadata': {}}])) to volume 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-4aba7743-4d66-4cbd-b041-2111102d55a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-4aba7743-4d66-4cbd-b041-2111102d55a1" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-4aba7743-4d66-4cbd-b041-2111102d55a1" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8538b1-bef7-4679-a96e-038b64346567]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541b90d-7f9c-4387-9cde-2528214dcf17]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.319s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleted volume successfully. Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9ec53945-a8ab-48a8-956e-3f4ee4717023 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-2f0406ec-e1c4-4ace-858f-4deb9cd51ce5-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:50 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm Sep 09 14:58:50 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:50 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 Sep 09 14:58:50 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:50 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 1073741824" returned: 0 in 0.511s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm" returned: 0 in 0.399s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 Sep 09 14:58:50 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:50 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1" returned: 0 in 0.436s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:50 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1 Sep 09 14:58:50 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm Sep 09 14:58:51 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398" returned: 0 in 0.280s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.971s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9663ff-48ac-4c82-af9b-a60243368621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df20f94-9234-4976-96eb-29c82ac92398', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c4f081-3901-47d9-9311-6ea4a1d0c862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 9914d2ed-b073-4a55-94d9-c8f275b3cfba of volume 20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:58:51 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-4aba7743-4d66-4cbd-b041-2111102d55a1" returned: 0 in 0.278s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a04b3c9-b034-4838-8b59-2d64cf32832d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:51 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-4aba7743-4d66-4cbd-b041-2111102d55a1" released by "delete_volume" :: held 0.772s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:51 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Volume volume-6df20f94-9234-4976-96eb-29c82ac92398 (6df20f94-9234-4976-96eb-29c82ac92398): created successfully Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c4f081-3901-47d9-9311-6ea4a1d0c862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (97ecbc96-4a7a-449b-b510-6bb69fac8765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm" returned: 1 in 0.382s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f23094-ddb2-4f9d-9606-ac0affe9e447_joekpnvm' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e12342-948a-4131-8708-528e2a0b0330]: (4, 'raw') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7f52d9f1-5f7e-4562-8685-9a2b63a128d0 tempest-ProjectReaderTests-803268646 None] Created volume successfully. Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['359bf40a-9b5b-4955-b8e6-7386041855e8', 'd7ec5cde-e0c5-4289-97de-93f1c29326ff', '5af11cd4-53dc-479c-8341-7a3336232779', '06076f3b-8345-457e-a280-89bf15674a01'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:51 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed Sep 09 14:58:51 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:51 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD Sep 09 14:58:51 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:51 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:51 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-81f0214f-28d6-4081-bcbd-4073e307afcf-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-81f0214f-28d6-4081-bcbd-4073e307afcf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-81f0214f-28d6-4081-bcbd-4073e307afcf" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:51 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed" returned: 0 in 0.432s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:51 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-81f0214f-28d6-4081-bcbd-4073e307afcf" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:51 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba 1G Sep 09 14:58:51 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb2304a-0bae-4020-9b66-336c8d6e9e99]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:51 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.329s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleted volume successfully. Sep 09 14:58:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d00148ad-d513-4045-843a-09457b0f0e44 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-4aba7743-4d66-4cbd-b041-2111102d55a1-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:51 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD Sep 09 14:58:51 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:51 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf Sep 09 14:58:51 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:52 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba 1G" returned: 0 in 0.509s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f972a5-b56b-4709-ab1c-49b6c8625eed -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD" returned: 1 in 0.489s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD' failed. Not Retrying. {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf" returned: 0 in 0.477s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] b4f23094-ddb2-4f9d-9606-ac0affe9e447 was raw, converting to qcow2 {{(pid=87325) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f972a5-b56b-4709-ab1c-49b6c8625eed -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba Sep 09 14:58:52 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd Sep 09 14:58:52 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf Sep 09 14:58:52 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:52 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f972a5-b56b-4709-ab1c-49b6c8625eed -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba" returned: 0 in 0.318s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba is being set with open permissions: ugo+rw Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-81f0214f-28d6-4081-bcbd-4073e307afcf" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba Sep 09 14:58:52 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-81f0214f-28d6-4081-bcbd-4073e307afcf" released by "delete_volume" :: held 0.855s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:52 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['7cb2ecb1-13b5-4a55-b149-b0a0d4fd65ee', 'd8fbbe30-3d45-4321-b3c8-abc18ae06f15', '7939c55e-f2ec-4ff4-9348-e0a34e71aa9b', 'bf289189-a867-4a2a-8092-9d42bea9464e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:52 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" returned: 0 in 0.542s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4f23094-ddb2-4f9d-9606-ac0affe9e447_9xctvx31devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:58:52 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-c0b2b729-0919-4fe9-9340-1986afa82962-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-c0b2b729-0919-4fe9-9340-1986afa82962-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:52 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd 1G Sep 09 14:58:52 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:52 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info Sep 09 14:58:52 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-c0b2b729-0919-4fe9-9340-1986afa82962" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-c0b2b729-0919-4fe9-9340-1986afa82962" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e51bf3-b514-4bea-8b82-cf8658f66a47]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:53 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.305s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleted volume successfully. Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1578b75c-f4a1-4131-b855-5beaab2cf6f6 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-81f0214f-28d6-4081-bcbd-4073e307afcf-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:53 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 Sep 09 14:58:53 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:53 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info is being set with open permissions: ugo+rw Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:53 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info Sep 09 14:58:53 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd 1G" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Downloaded image b4f23094-ddb2-4f9d-9606-ac0affe9e447 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'metadata': {}}])) to volume 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd successfully. {{(pid=87325) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Temporary image b4f23094-ddb2-4f9d-9606-ac0affe9e447 for user 01b8fe6bee3f4e748f8549075ce2481f is deleted. {{(pid=87325) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.volume_utils [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Marking volume 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd as bootable. {{(pid=87325) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Copying metadata from image b4f23094-ddb2-4f9d-9606-ac0affe9e447 to 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd. {{(pid=87325) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Creating volume glance metadata for volume 48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd backed by image b4f23094-ddb2-4f9d-9606-ac0affe9e447 with: {'image_id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2c744e4cb0d99bd8def244a7caef2012', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87325) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ccb1a1-7a56-428c-88c3-1cb5491ede54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd', 'volume_size': 1, 'image_id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c744e4cb0d99bd8def244a7caef2012', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb2ca7ae2a02451bb291135029f4ecf5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72935f607bf73d3f224c5f720c3c445f6e89f647283a4a24987165c492509844b29fd77df2502acc2c0656b3699f33514bf6b7ae50bfa99278ec70f236bcaf75', 'id': 'b4f23094-ddb2-4f9d-9606-ac0affe9e447', 'created_at': datetime.datetime(2026, 9, 9, 12, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 12, 58, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f23094-ddb2-4f9d-9606-ac0affe9e447/file', 'properties': {}}, 'image_service': }' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebbbcc8-73d8-42c6-9def-89854f1df5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Volume volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd (48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd): created successfully Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebbbcc8-73d8-42c6-9def-89854f1df5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Flow 'volume_create_manager' (c3661c53-d053-4a88-ac6a-b09a64568cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1deb8d7f-98d2-456d-b0f7-d0a215612763 tempest-VolumeImageDependencyTests-1051342815 None] Created volume successfully. Sep 09 14:58:53 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962" returned: 0 in 0.453s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:53 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.info" returned: 0 in 0.296s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962 Sep 09 14:58:53 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.308s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Creating offline snapshot b6a52a52-50a9-44a4-bdfe-8f240419af71 of volume 6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:58:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-723c9030-d101-4829-b461-3e9347a3a301 tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec3975-c949-4186-ac1d-9e63d20b25ae]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:53 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 Sep 09 14:58:53 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:53 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c0b2b729-0919-4fe9-9340-1986afa82962" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-c0b2b729-0919-4fe9-9340-1986afa82962" released by "delete_volume" :: held 0.760s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['4f86c1a2-cbbf-4828-b22a-48e68fc99939', '35c3bf52-3fed-470c-86bf-9483b23bbb89', '55035c01-0a4d-4e21-81c5-c67d9eeb54e0', 'fb84b29e-ed70-4d71-8971-4174f058ded9'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:53 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:53 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:53 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398" returned: 0 in 0.363s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:53 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 1G Sep 09 14:58:53 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-dad4ddfb-bef1-4237-9fd9-3755b4951d40-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-dad4ddfb-bef1-4237-9fd9-3755b4951d40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-dad4ddfb-bef1-4237-9fd9-3755b4951d40" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-dad4ddfb-bef1-4237-9fd9-3755b4951d40" acquired by "delete_volume" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27a94e1-2c7d-4080-8e40-69d168a20c75]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:54 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.308s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:54 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleted volume successfully. Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-657a4823-4184-41cd-b6b3-60106d00f114 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-c0b2b729-0919-4fe9-9340-1986afa82962-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:54 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 Sep 09 14:58:54 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:54 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 1G" returned: 0 in 0.450s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df20f94-9234-4976-96eb-29c82ac92398 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:54 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df20f94-9234-4976-96eb-29c82ac92398 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 Sep 09 14:58:54 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-9914d2ed-b073-4a55-94d9-c8f275b3cfba-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Acquiring lock "cinder-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-9914d2ed-b073-4a55-94d9-c8f275b3cfba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-20f972a5-b56b-4709-ab1c-49b6c8625eed" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Lock "cinder-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-20f972a5-b56b-4709-ab1c-49b6c8625eed" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-9914d2ed-b073-4a55-94d9-c8f275b3cfba" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:54 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40" returned: 0 in 0.430s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-9914d2ed-b073-4a55-94d9-c8f275b3cfba" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 9914d2ed-b073-4a55-94d9-c8f275b3cfba of volume 20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:58:54 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40 Sep 09 14:58:54 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd4d9a-7cf8-4a1b-a89b-11f1445392e8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Acquiring lock "cinder-quobyte-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Lock "cinder-quobyte-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[06da9426-dae7-4427-8437-0f0119ba4c3b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:54 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df20f94-9234-4976-96eb-29c82ac92398 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71" returned: 0 in 0.376s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:54 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 is being set with open permissions: ugo+rw Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:54 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba Sep 09 14:58:54 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:54 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 Sep 09 14:58:54 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:54 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd Sep 09 14:58:54 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:54 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dad4ddfb-bef1-4237-9fd9-3755b4951d40" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-dad4ddfb-bef1-4237-9fd9-3755b4951d40" released by "delete_volume" :: held 0.794s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['58ac789e-654d-4ad3-9952-e8059b0a9065', 'a9939dfd-d002-4e94-82af-9591f4769509', '8fa0572b-679c-48b0-97b8-116f52bc2144', '5c7df167-898a-4264-a705-62a3c1b10c37'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:54 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71" returned: 0 in 0.278s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba" returned: 0 in 0.433s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20f972a5-b56b-4709-ab1c-49b6c8625eed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:58:55 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:55 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a5ce86-0140-42e4-97d0-9bb663b87b65]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info Sep 09 14:58:55 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" returned: 0 in 0.491s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-5a0368ce-a487-4959-9483-b48b8784bde2-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:55 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed Sep 09 14:58:55 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd Sep 09 14:58:55 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-5a0368ce-a487-4959-9483-b48b8784bde2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-94f52a20-6d87-481a-9462-105caeb6c687" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-94f52a20-6d87-481a-9462-105caeb6c687" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-5a0368ce-a487-4959-9483-b48b8784bde2" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-5a0368ce-a487-4959-9483-b48b8784bde2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleting offline snapshot 5a0368ce-a487-4959-9483-b48b8784bde2 of volume 94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] snapshot_file for this snap is: volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:58:55 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95fbe99-1a12-466a-8795-528ad8e1994b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.371s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:55 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info" returned: 0 in 0.345s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info is being set with open permissions: ugo+rw Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleted volume successfully. Sep 09 14:58:55 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info Sep 09 14:58:55 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-759226da-0124-4222-b1f2-7fa3050270f5 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-dad4ddfb-bef1-4237-9fd9-3755b4951d40-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:55 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 Sep 09 14:58:55 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Lock "cinder-quobyte-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd" released by "delete_volume" :: held 0.911s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:55 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed" returned: 0 in 0.494s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba Sep 09 14:58:55 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Created reservations ['e28260a4-99a4-426b-9fcf-704f08743649', '0e7f1dd3-eac9-42dc-8023-e5725b82dc00', 'ec353e60-7743-4624-9776-bf314c54a94e', '27741000-44d6-49b1-a545-b0e0ce4f86af'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.info" returned: 0 in 0.371s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:55 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:55 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2" returned: 0 in 0.450s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f52a20-6d87-481a-9462-105caeb6c687(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cdfe64-94b5-4ffc-80fe-bb8313c52ce7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-92f85944-196b-4c27-8fe2-05984c4176e7 tempest-ProjectReaderTests-803268646 None] Create snapshot completed successfully Sep 09 14:58:55 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 Sep 09 14:58:55 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:55 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:56 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba Sep 09 14:58:56 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:56 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.295s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Deleted volume successfully. Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-927ffe45-ce16-4b38-8c12-83915a7af482 tempest-VolumeImageDependencyTests-1051342815 None] Lock "cinder-48a3f3db-f120-4bf0-a6b1-342ae6e8e0fd-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:56 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:56 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed.9914d2ed-b073-4a55-94d9-c8f275b3cfba" returned: 0 in 0.269s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:56 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 Sep 09 14:58:56 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-9914d2ed-b073-4a55-94d9-c8f275b3cfba" released by "_delete_snapshot" :: held 1.784s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-20f972a5-b56b-4709-ab1c-49b6c8625eed" released by "delete_snapshot" :: held 1.824s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-b6a52a52-50a9-44a4-bdfe-8f240419af71-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Created reservations ['67160447-eb7a-4089-a740-d57fcb3b5e9a', '13d82eb0-f81e-437b-8ec7-7f355962a981', 'ee5e481d-9353-44cd-acfc-0dd5180ee223', '14f5b1f6-d8c4-4485-9b5d-3767c67d1f02'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Lock "cinder-b6a52a52-50a9-44a4-bdfe-8f240419af71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-6df20f94-9234-4976-96eb-29c82ac92398" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-6df20f94-9234-4976-96eb-29c82ac92398" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-b6a52a52-50a9-44a4-bdfe-8f240419af71" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-b6a52a52-50a9-44a4-bdfe-8f240419af71" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Deleting offline snapshot b6a52a52-50a9-44a4-bdfe-8f240419af71 of volume 6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] snapshot_file for this snap is: volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:58:56 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-776629c2-3858-4413-b3b4-1ca2196e5dc4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-9914d2ed-b073-4a55-94d9-c8f275b3cfba-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c3bdf-9552-4da6-b14b-aef0219830e7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:56 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:56 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 Sep 09 14:58:56 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-20f972a5-b56b-4709-ab1c-49b6c8625eed-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:56 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2 Sep 09 14:58:56 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Lock "cinder-20f972a5-b56b-4709-ab1c-49b6c8625eed-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-20f972a5-b56b-4709-ab1c-49b6c8625eed" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-20f972a5-b56b-4709-ab1c-49b6c8625eed" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[105f05fb-beea-4bbf-814a-44962c9e4f29]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:56 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71" returned: 0 in 0.415s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df20f94-9234-4976-96eb-29c82ac92398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a3206-0092-4e66-819a-33ce14f404f2]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:56 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687.5a0368ce-a487-4959-9483-b48b8784bde2" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:57 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed Sep 09 14:58:57 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-5a0368ce-a487-4959-9483-b48b8784bde2" released by "_delete_snapshot" :: held 1.753s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-94f52a20-6d87-481a-9462-105caeb6c687" released by "delete_snapshot" :: held 1.793s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:57 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 Sep 09 14:58:57 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['ea8b4ffd-4faa-445c-b683-545936edd116', '8d34114d-a939-4db1-87cb-3aea3513ea48', 'af77b1f6-87c9-4796-867c-ddca20e34866', '4f2f1d69-c23f-4eb8-b8a1-2bab367173b2'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Delete snapshot completed successfully. Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73ef74fb-173e-4b5a-9974-ece58ef916d3 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-5a0368ce-a487-4959-9483-b48b8784bde2-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:57 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed" returned: 0 in 0.481s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-94f52a20-6d87-481a-9462-105caeb6c687-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:57 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed Sep 09 14:58:57 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-94f52a20-6d87-481a-9462-105caeb6c687-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:57 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398" returned: 0 in 0.454s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "cinder-quobyte-94f52a20-6d87-481a-9462-105caeb6c687" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:57 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 Sep 09 14:58:57 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-94f52a20-6d87-481a-9462-105caeb6c687" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[10174e5e-fe68-41e9-b55c-2e6132e793a5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:57 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 Sep 09 14:58:57 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:57 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-20f972a5-b56b-4709-ab1c-49b6c8625eed" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-20f972a5-b56b-4709-ab1c-49b6c8625eed" released by "delete_volume" :: held 0.897s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Created reservations ['3dca22aa-d9a3-47a0-9657-a1584adc9d8a', '5e2538f1-5d64-4908-8804-d18296ba3e41', '93a5b02a-f55f-4b4f-88da-d428ebe2391a', '07759338-9847-45cf-a12f-ad8ef51ceeae'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:57 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:57 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:57 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71" returned: 0 in 0.518s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:57 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71 Sep 09 14:58:57 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:58 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687" returned: 0 in 0.517s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:58 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687 Sep 09 14:58:58 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:58 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-eb312e02-a513-49be-ac42-ed46ee6fd900 tempest-ProjectMemberTests-220436694 None] Lock "cinder-20f972a5-b56b-4709-ab1c-49b6c8625eed-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:58 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398.b6a52a52-50a9-44a4-bdfe-8f240419af71" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-b6a52a52-50a9-44a4-bdfe-8f240419af71" released by "_delete_snapshot" :: held 1.810s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-6df20f94-9234-4976-96eb-29c82ac92398" released by "delete_snapshot" :: held 1.846s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Created reservations ['f7bf41f7-c339-483b-b0a7-06ff27f02d1c', '264488eb-fdf2-4d8d-982a-93e6839f7699', '75bf2776-76d1-4f9d-9186-e36050eb9284', 'b0dcaaea-dbf8-45d7-b91c-85b4d9e72a2d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:58 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-94f52a20-6d87-481a-9462-105caeb6c687" returned: 0 in 0.338s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-quobyte-94f52a20-6d87-481a-9462-105caeb6c687" released by "delete_volume" :: held 0.934s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Delete snapshot completed successfully. Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c9a11765-26eb-4ad7-866d-92117e118704 tempest-ProjectReaderTests-803268646 None] Lock "cinder-b6a52a52-50a9-44a4-bdfe-8f240419af71-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Created reservations ['1940228c-2bc8-40eb-ac2a-e9fa77b67408', '3845f448-fff7-4c1e-a0db-651b270c1e6f', '1ad69cad-e1c9-464f-b732-9d72e7a604d2', 'af93194a-b5e0-4e6e-bc78-5d3f37fd9765'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:58 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:58 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-6df20f94-9234-4976-96eb-29c82ac92398-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-6df20f94-9234-4976-96eb-29c82ac92398-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-6df20f94-9234-4976-96eb-29c82ac92398" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-6df20f94-9234-4976-96eb-29c82ac92398" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bafff0e-4a01-43ea-ae0c-c1eb47c73104]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:58 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.274s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:58:58 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Deleted volume successfully. Sep 09 14:58:58 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 Sep 09 14:58:58 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:58 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2d22b9a3-93df-4036-b8c2-8bdd8023cf18 tempest-CreateVolumesFromSnapshotTest-1607348728 None] Lock "cinder-94f52a20-6d87-481a-9462-105caeb6c687-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:59 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:59 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398 Sep 09 14:58:59 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:58:59 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (43b0b244-ce5e-48a6-8306-ac88556df0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21975ea-f2ae-4d36-8f7b-8594172bed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6df20f94-9234-4976-96eb-29c82ac92398" returned: 0 in 0.321s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-6df20f94-9234-4976-96eb-29c82ac92398" released by "delete_volume" :: held 0.797s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21975ea-f2ae-4d36-8f7b-8594172bed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572430648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5140d53-9079-4e9d-8609-067b033a2003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:59Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc90dcb-346b-4a18-bb63-847d1281d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc90dcb-346b-4a18-bb63-847d1281d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d755c96-7b11-4034-b4b7-242a1549a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d755c96-7b11-4034-b4b7-242a1549a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5140d53-9079-4e9d-8609-067b033a2003', 'volume_name': 'volume-b5140d53-9079-4e9d-8609-067b033a2003', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0af5a2-61a9-4ac1-893e-31b34e7256bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0af5a2-61a9-4ac1-893e-31b34e7256bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427c0262-b269-4a26-a7da-211a34f4c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:58:59 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Volume b5140d53-9079-4e9d-8609-067b033a2003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5140d53-9079-4e9d-8609-067b033a2003', 'volume_size': 1} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572430648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5140d53-9079-4e9d-8609-067b033a2003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:58:59Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Creating volume b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:58:59 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:59 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 1073741824 Sep 09 14:58:59 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Created reservations ['855ef145-1e61-4a73-bb4a-4deae89892b8', 'f85ad736-e7ba-432a-96b6-b561c7d23902', '669a70db-c9e2-411c-89e3-2e0cd3a81dec', 'f17dbaae-50a0-4493-89ac-a3b366bceb18'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:58:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:58:59 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:58:59 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:00 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.378s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:00 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Deleted volume successfully. Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3511aa-91ab-491a-89f6-5ccb28a78ea3 tempest-ProjectReaderTests-803268646 None] Lock "cinder-6df20f94-9234-4976-96eb-29c82ac92398-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:00 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 1073741824" returned: 0 in 0.678s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:00 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 Sep 09 14:59:00 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (ab61f358-535a-4b00-a6a3-a63ff748270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa188e58-2d13-4dbb-ac5d-710899644480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa188e58-2d13-4dbb-ac5d-710899644480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499544565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6cb625-36bd-4c56-a9c8-0be0f5916b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:00Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4900a864-86f8-4906-9cb3-5e02089cdb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4900a864-86f8-4906-9cb3-5e02089cdb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b866a8b6-52da-49a8-956e-c2dd06714006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b866a8b6-52da-49a8-956e-c2dd06714006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6cb625-36bd-4c56-a9c8-0be0f5916b90', 'volume_name': 'volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727a3791-1bce-4bb5-b2e7-371b773cdc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727a3791-1bce-4bb5-b2e7-371b773cdc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857bb2ed-77db-499a-9f21-462486a8af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Volume cd6cb625-36bd-4c56-a9c8-0be0f5916b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90', 'volume_size': 1} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003" returned: 0 in 0.315s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499544565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6cb625-36bd-4c56-a9c8-0be0f5916b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:00Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Creating volume cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:00 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:00 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 1073741824 Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427c0262-b269-4a26-a7da-211a34f4c57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5140d53-9079-4e9d-8609-067b033a2003', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b2323c-e006-4b8d-a77f-643ca24931ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Volume volume-b5140d53-9079-4e9d-8609-067b033a2003 (b5140d53-9079-4e9d-8609-067b033a2003): created successfully Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b2323c-e006-4b8d-a77f-643ca24931ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (43b0b244-ce5e-48a6-8306-ac88556df0f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:00 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9ab23ca4-c7b8-4184-8037-463e6e46d32f tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Flow 'volume_create_manager' (f93d10c5-f9bf-4150-90db-00ddd9135410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961a5cd2-3f1e-45d4-8ce5-914aefb0d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961a5cd2-3f1e-45d4-8ce5-914aefb0d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763a63c4b4d14b8b8dde13a1f83428a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:01Z,use_quota=True,user_id='e4c87bb77fa84ccbafbdedf666366f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434d4712-07c4-4cf0-ac6f-7243505d0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434d4712-07c4-4cf0-ac6f-7243505d0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d2d649-77aa-41c1-9a39-fee43a45af95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d2d649-77aa-41c1-9a39-fee43a45af95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e', 'volume_name': 'volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eabd9ed-58ef-4ed2-bb6e-2a4a3a9cf3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eabd9ed-58ef-4ed2-bb6e-2a4a3a9cf3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902815cb-fff7-4532-a34a-28fa1a8a0c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:00 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Volume dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e', 'volume_size': 1} Sep 09 14:59:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:01 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 1073741824" returned: 0 in 0.517s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:01 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 Sep 09 14:59:01 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:01 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" returned: 0 in 0.273s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763a63c4b4d14b8b8dde13a1f83428a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:01Z,use_quota=True,user_id='e4c87bb77fa84ccbafbdedf666366f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Creating volume dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:01 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857bb2ed-77db-499a-9f21-462486a8af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63edfb24-d51b-4384-acf8-bad5e0d774ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:01 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e 1073741824 Sep 09 14:59:01 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:01 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Volume volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 (cd6cb625-36bd-4c56-a9c8-0be0f5916b90): created successfully Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63edfb24-d51b-4384-acf8-bad5e0d774ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (ab61f358-535a-4b00-a6a3-a63ff748270f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-335c0063-f3b3-4756-b660-08e636880f04 tempest-ProjectReaderTests-803268646 None] Created volume successfully. Sep 09 14:59:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:02 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e 1073741824" returned: 0 in 0.540s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:02 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e Sep 09 14:59:02 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:02 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e" returned: 0 in 0.347s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Creating offline snapshot ac6d1172-2375-4f0f-bbf4-fbddcb70ceea of volume b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902815cb-fff7-4532-a34a-28fa1a8a0c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec858fce-1f4d-4175-9575-105dd2e6c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c0fa02-98c3-4cc2-b3fa-b720c2c18221]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:02 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Volume volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e (dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e): created successfully Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec858fce-1f4d-4175-9575-105dd2e6c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Flow 'volume_create_manager' (f93d10c5-f9bf-4150-90db-00ddd9135410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:02 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a2449ce5-5677-4bf7-bac0-3f08f87ddb68 tempest-CinderUnicodeTest-432213698 None] Created volume successfully. Sep 09 14:59:02 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 Sep 09 14:59:02 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:02 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003" returned: 0 in 0.410s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:02 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea 1G Sep 09 14:59:02 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Flow 'volume_create_manager' (61cbd88b-6ccb-4852-90ba-1c6fd7e28fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608996ee-5968-499d-a0c9-d2e510788e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608996ee-5968-499d-a0c9-d2e510788e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1937479292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722456ab-64a4-4e46-838b-e01854d2be43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8ebe156e8548968e5230958b17c6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:03Z,use_quota=True,user_id='a8012076ca864147a3626964836b96d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e180718b-a797-4d5c-bcef-789c20883dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e180718b-a797-4d5c-bcef-789c20883dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e300b166-e4a9-4dec-8ed7-c067945994f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e300b166-e4a9-4dec-8ed7-c067945994f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722456ab-64a4-4e46-838b-e01854d2be43', 'volume_name': 'volume-722456ab-64a4-4e46-838b-e01854d2be43', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4807aa4c-acea-4cba-a6fb-f3a2719d2937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4807aa4c-acea-4cba-a6fb-f3a2719d2937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee13f4a-5f1d-437b-8584-3d6cb497904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Volume 722456ab-64a4-4e46-838b-e01854d2be43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722456ab-64a4-4e46-838b-e01854d2be43', 'volume_size': 1} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:03 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea 1G" returned: 0 in 0.507s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5140d53-9079-4e9d-8609-067b033a2003 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:03 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5140d53-9079-4e9d-8609-067b033a2003 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea Sep 09 14:59:03 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Flow 'volume_create_manager' (d8c8efcd-e5fb-4c32-961c-4b560c37797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2816bb2a-d185-4054-893b-8e7973f9d6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2816bb2a-d185-4054-893b-8e7973f9d6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1401105107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1f013e-0284-4882-a289-5ada5f379625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763a63c4b4d14b8b8dde13a1f83428a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:03Z,use_quota=True,user_id='e4c87bb77fa84ccbafbdedf666366f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b093d67e-a465-4060-bc2b-20cbe0b250de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b093d67e-a465-4060-bc2b-20cbe0b250de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c321e3d6-6cda-474b-86d8-13ccc90ed3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c321e3d6-6cda-474b-86d8-13ccc90ed3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1f013e-0284-4882-a289-5ada5f379625', 'volume_name': 'volume-8f1f013e-0284-4882-a289-5ada5f379625', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64e185f-5707-4390-a509-ecf234b36eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64e185f-5707-4390-a509-ecf234b36eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f4d474-3cf1-4ec6-8499-88fc51cf96bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:03 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Volume 8f1f013e-0284-4882-a289-5ada5f379625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1f013e-0284-4882-a289-5ada5f379625', 'volume_size': 1} Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:03 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5140d53-9079-4e9d-8609-067b033a2003 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" returned: 0 in 0.288s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:03 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea is being set with open permissions: ugo+rw Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:03 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea Sep 09 14:59:03 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:03 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:04 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info Sep 09 14:59:04 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:04 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:04 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info is being set with open permissions: ugo+rw Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:04 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info Sep 09 14:59:04 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:04 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.info" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.805s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Creating offline snapshot aff0d4da-8efa-41b6-b62d-31cec104a336 of volume cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:04 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-39867865-6678-4a8e-8f9b-6dcab13d26cd tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbc5ddd-74fd-4c75-a0f6-e3a6c431b607]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:04 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 Sep 09 14:59:04 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:04 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" returned: 0 in 0.395s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-ac6d1172-2375-4f0f-bbf4-fbddcb70ceea-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:04 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 1G Sep 09 14:59:04 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Lock "cinder-ac6d1172-2375-4f0f-bbf4-fbddcb70ceea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-b5140d53-9079-4e9d-8609-067b033a2003" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-b5140d53-9079-4e9d-8609-067b033a2003" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot ac6d1172-2375-4f0f-bbf4-fbddcb70ceea of volume b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d8dda-e2fb-47c9-862c-b18d28be2e93]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:05 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea Sep 09 14:59:05 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:05 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 1G" returned: 0 in 0.460s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:05 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" returned: 0 in 0.376s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5140d53-9079-4e9d-8609-067b033a2003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:05 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 Sep 09 14:59:05 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e389631-0a81-42cb-917e-938feb6ffffe]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:05 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 Sep 09 14:59:05 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:05 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336" returned: 0 in 0.292s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:05 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 is being set with open permissions: ugo+rw Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:05 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 Sep 09 14:59:05 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:05 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003" returned: 0 in 0.381s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:05 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea Sep 09 14:59:05 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:05 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:06 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info Sep 09 14:59:06 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:06 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" returned: 0 in 0.339s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:06 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea Sep 09 14:59:06 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:06 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:06 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info is being set with open permissions: ugo+rw Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:06 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info Sep 09 14:59:06 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:06 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003.ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" returned: 0 in 0.249s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-ac6d1172-2375-4f0f-bbf4-fbddcb70ceea" released by "_delete_snapshot" :: held 1.452s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-b5140d53-9079-4e9d-8609-067b033a2003" released by "delete_snapshot" :: held 1.475s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Created reservations ['a43979c1-a6ac-4be8-af3a-7b8edf3fce29', 'be4f53cc-479d-463f-8baa-67263eea54b1', '4050cbe9-f246-46b8-ae6e-b00d8323b210', '5ec1510b-3181-4b83-bb53-4007001f872c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:06 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.info" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.172s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1937479292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722456ab-64a4-4e46-838b-e01854d2be43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8ebe156e8548968e5230958b17c6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:03Z,use_quota=True,user_id='a8012076ca864147a3626964836b96d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Creating volume 722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:06 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:06 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 1073741824 Sep 09 14:59:06 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-da1bb0a2-3e53-4ad0-b65a-1a0f29fc02ec tempest-ProjectReaderTests-803268646 None] Create snapshot completed successfully Sep 09 14:59:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f52d27af-a19d-4b5c-a398-4f876730f51c tempest-ProjectMemberTests-220436694 None] Lock "cinder-ac6d1172-2375-4f0f-bbf4-fbddcb70ceea-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-aff0d4da-8efa-41b6-b62d-31cec104a336-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Lock "cinder-aff0d4da-8efa-41b6-b62d-31cec104a336-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-aff0d4da-8efa-41b6-b62d-31cec104a336" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:06 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-aff0d4da-8efa-41b6-b62d-31cec104a336" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Deleting offline snapshot aff0d4da-8efa-41b6-b62d-31cec104a336 of volume cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] snapshot_file for this snap is: volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bce8093-e7ce-4d15-b09a-ea23ca52448d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 1073741824" returned: 0 in 0.513s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 Sep 09 14:59:07 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 Sep 09 14:59:07 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-b5140d53-9079-4e9d-8609-067b033a2003-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Lock "cinder-b5140d53-9079-4e9d-8609-067b033a2003-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-b5140d53-9079-4e9d-8609-067b033a2003" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-b5140d53-9079-4e9d-8609-067b033a2003" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15732e7-f5a4-437e-a964-db3d0090fa7d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336" returned: 0 in 0.409s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:07 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43" returned: 0 in 0.322s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.885s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1401105107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1f013e-0284-4882-a289-5ada5f379625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763a63c4b4d14b8b8dde13a1f83428a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:03Z,use_quota=True,user_id='e4c87bb77fa84ccbafbdedf666366f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Creating volume 8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:07 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 Sep 09 14:59:07 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:07 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f005154-2546-4f54-a562-ad62ba386616]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 1073741824 Sep 09 14:59:07 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee13f4a-5f1d-437b-8584-3d6cb497904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722456ab-64a4-4e46-838b-e01854d2be43', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c6df6c-a8aa-4642-a103-cb000082a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:07 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Volume volume-722456ab-64a4-4e46-838b-e01854d2be43 (722456ab-64a4-4e46-838b-e01854d2be43): created successfully Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c6df6c-a8aa-4642-a103-cb000082a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Flow 'volume_create_manager' (61cbd88b-6ccb-4852-90ba-1c6fd7e28fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:07 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f47fac69-e185-4b58-abcf-c4d91f54d6ce tempest-VolumeDependencyTests-323332019 None] Created volume successfully. Sep 09 14:59:07 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 Sep 09 14:59:07 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003" returned: 0 in 0.393s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003 Sep 09 14:59:07 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" returned: 0 in 0.417s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:07 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 1073741824" returned: 0 in 0.453s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:07 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 Sep 09 14:59:07 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:07 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:08 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 Sep 09 14:59:08 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:08 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b5140d53-9079-4e9d-8609-067b033a2003" returned: 0 in 0.285s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-b5140d53-9079-4e9d-8609-067b033a2003" released by "delete_volume" :: held 0.736s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Created reservations ['83e634f5-2892-484a-992d-92dd5b643daf', '565ceb51-2aea-41d0-a371-40f579e41c42', '525e16ae-90d8-496e-90dd-55931c384eed', '86a1a5c3-e281-40a7-b017-1601cf55de0f'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:08 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:08 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:08 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625" returned: 0 in 0.268s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f4d474-3cf1-4ec6-8499-88fc51cf96bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1f013e-0284-4882-a289-5ada5f379625', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d9b08-6f81-4c7c-8cb9-ce646af69d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:08 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336" returned: 0 in 0.357s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:08 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Volume volume-8f1f013e-0284-4882-a289-5ada5f379625 (8f1f013e-0284-4882-a289-5ada5f379625): created successfully Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d9b08-6f81-4c7c-8cb9-ce646af69d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Flow 'volume_create_manager' (d8c8efcd-e5fb-4c32-961c-4b560c37797d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:08 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336 Sep 09 14:59:08 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9b1e13a4-3e40-4ea4-a9b8-dc197ac54007 tempest-CinderUnicodeTest-432213698 None] Created volume successfully. Sep 09 14:59:08 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.280s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-e222270f-63fe-4ef1-848a-578b146703aa tempest-ProjectMemberTests-220436694 None] Lock "cinder-b5140d53-9079-4e9d-8609-067b033a2003-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:08 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90.aff0d4da-8efa-41b6-b62d-31cec104a336" returned: 0 in 0.282s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-aff0d4da-8efa-41b6-b62d-31cec104a336" released by "_delete_snapshot" :: held 1.594s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" released by "delete_snapshot" :: held 1.629s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Created reservations ['9162de4b-fdee-4488-bd06-a0cbd14c629e', '30354b90-06e6-45b1-9685-180c6c3a390a', '6cfd735b-a88a-4a25-b7ca-0901e909c325', '71f96a00-832f-42d9-8236-6282013d6fed'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:08 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Delete snapshot completed successfully. Sep 09 14:59:08 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-760389e9-1b99-48bf-b4db-0cbf3f2f9958 tempest-ProjectReaderTests-803268646 None] Lock "cinder-aff0d4da-8efa-41b6-b62d-31cec104a336-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Creating offline snapshot a7584fcb-fc66-461d-8bac-3a2284236920 of volume 722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (0d1c6327-43a1-4e47-8ae7-f751478c81a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747be859-7420-43f8-9207-97d6d95d3105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcfb6f8-5885-4a4e-8354-0363e063ef72]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747be859-7420-43f8-9207-97d6d95d3105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775077799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c411d807-2a92-49a7-9cdc-2d3658ff7b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:09Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0abf818-f294-4546-adf4-91bbc782d989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0abf818-f294-4546-adf4-91bbc782d989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06311e2a-fdcb-4af9-a962-b88a6ae10e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06311e2a-fdcb-4af9-a962-b88a6ae10e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c411d807-2a92-49a7-9cdc-2d3658ff7b1b', 'volume_name': 'volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8736446f-44b2-4e9b-abe0-7156e1318269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8736446f-44b2-4e9b-abe0-7156e1318269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05db9b17-3fab-4ed3-89a4-7550e2701ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:09 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Volume c411d807-2a92-49a7-9cdc-2d3658ff7b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b', 'volume_size': 1} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-cd6cb625-36bd-4c56-a9c8-0be0f5916b90-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Lock "cinder-cd6cb625-36bd-4c56-a9c8-0be0f5916b90-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:09 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 Sep 09 14:59:09 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[665575d1-730d-4942-9e66-9d922a36fc37]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:09 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 Sep 09 14:59:09 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:09 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43" returned: 0 in 0.400s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:09 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 1G Sep 09 14:59:09 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:09 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:09 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90 Sep 09 14:59:09 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:09 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 1G" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722456ab-64a4-4e46-838b-e01854d2be43 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:09 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" returned: 0 in 0.287s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:09 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722456ab-64a4-4e46-838b-e01854d2be43 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 Sep 09 14:59:09 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:09 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-cd6cb625-36bd-4c56-a9c8-0be0f5916b90" released by "delete_volume" :: held 0.707s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Created reservations ['3bb9fb3c-b6eb-47bc-a148-b851270e1b16', '11d83b04-afa8-48c7-896e-a82ebb326b8b', '910be28e-5fb8-4596-b6c8-f5ac282b5bba', '5be63cf5-87b0-41c2-8f44-8efa92e6f71a'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:10 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:10 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:10 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722456ab-64a4-4e46-838b-e01854d2be43 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920" returned: 0 in 0.321s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:10 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 is being set with open permissions: ugo+rw Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:10 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 Sep 09 14:59:10 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:10 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Deleted volume successfully. Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-edc8a6d1-5041-4802-88a9-9591739cc0c1 tempest-ProjectReaderTests-803268646 None] Lock "cinder-cd6cb625-36bd-4c56-a9c8-0be0f5916b90-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:10 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920" returned: 0 in 0.278s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:10 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info Sep 09 14:59:10 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:10 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (fc321d1c-46de-4a63-8e86-78115f123e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82fae85-4a03-4df3-87d6-2fe18236ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info" returned: 0 in 0.305s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:10 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info is being set with open permissions: ugo+rw Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82fae85-4a03-4df3-87d6-2fe18236ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421784117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d88f510-a4a6-4324-b709-3581dc81511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:11Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:10 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info Sep 09 14:59:10 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9016a4-ea93-45f8-9ee5-3f950c9ceb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9016a4-ea93-45f8-9ee5-3f950c9ceb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d5aac1-e2a5-4c69-82b6-ccd3fc8b23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d5aac1-e2a5-4c69-82b6-ccd3fc8b23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d88f510-a4a6-4324-b709-3581dc81511b', 'volume_name': 'volume-8d88f510-a4a6-4324-b709-3581dc81511b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c6dc64-60a7-4acf-a1c0-fa1d456150fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c6dc64-60a7-4acf-a1c0-fa1d456150fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a07bc8-0dad-4e56-96cd-ea9ff50b19da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:10 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Volume 8d88f510-a4a6-4324-b709-3581dc81511b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d88f510-a4a6-4324-b709-3581dc81511b', 'volume_size': 1} Sep 09 14:59:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:11 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.info" returned: 0 in 0.252s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775077799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c411d807-2a92-49a7-9cdc-2d3658ff7b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:09Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Creating volume c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:11 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:11 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b 1073741824 Sep 09 14:59:11 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b55cb468-f46f-4c68-a024-cdf6f0e98fa7 tempest-VolumeDependencyTests-323332019 None] Create snapshot completed successfully Sep 09 14:59:11 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b 1073741824" returned: 0 in 0.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:11 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b Sep 09 14:59:11 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:11 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" returned: 0 in 0.247s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.605s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05db9b17-3fab-4ed3-89a4-7550e2701ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d51bfd-8fc2-49c7-9dc7-e2d83d1ab9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Creating offline snapshot 695d6733-2dc6-42b9-8bd7-486e25ef963d of volume 8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:11 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Volume volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b (c411d807-2a92-49a7-9cdc-2d3658ff7b1b): created successfully Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d51bfd-8fc2-49c7-9dc7-e2d83d1ab9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (0d1c6327-43a1-4e47-8ae7-f751478c81a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d6cd17-e17e-4df9-9d91-1331efd08281]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5f5e7442-0724-4187-af92-b9a3d85e50ce tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:59:11 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=249,cinder:UPDATE=326,cinder:INSERT=88,cinder:DELETE=35 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:59:12 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 Sep 09 14:59:12 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=260,cinder:UPDATE=357,cinder:DELETE=27,cinder:INSERT=96 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:12 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:12 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d 1G Sep 09 14:59:12 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Flow 'volume_create_manager' (1b16145e-800e-4399-b2cc-b6766e653c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c9b547-1970-4b9d-8373-93a6e259b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c9b547-1970-4b9d-8373-93a6e259b44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-542500129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8894cc63-645f-4b86-bb18-baf640c9b987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8ebe156e8548968e5230958b17c6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a7584fcb-fc66-461d-8bac-3a2284236920,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:12Z,use_quota=True,user_id='a8012076ca864147a3626964836b96d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc21594d-f1fe-4065-8ea6-8054e29b6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc21594d-f1fe-4065-8ea6-8054e29b6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de60cc66-bce8-45f6-8155-13ddcdac4b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de60cc66-bce8-45f6-8155-13ddcdac4b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8894cc63-645f-4b86-bb18-baf640c9b987', 'volume_name': 'volume-8894cc63-645f-4b86-bb18-baf640c9b987', 'volume_size': 1, 'snapshot_id': 'a7584fcb-fc66-461d-8bac-3a2284236920'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934a8f92-8e5a-409e-91b0-76d97d88b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934a8f92-8e5a-409e-91b0-76d97d88b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b907b66-7b3f-4c93-a42f-158fb24611d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:12 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Volume 8894cc63-645f-4b86-bb18-baf640c9b987: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8894cc63-645f-4b86-bb18-baf640c9b987', 'volume_size': 1, 'snapshot_id': 'a7584fcb-fc66-461d-8bac-3a2284236920'} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:12 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d 1G" returned: 0 in 0.397s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1f013e-0284-4882-a289-5ada5f379625 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:12 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1f013e-0284-4882-a289-5ada5f379625 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d Sep 09 14:59:12 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:13 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f1f013e-0284-4882-a289-5ada5f379625 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d" returned: 0 in 0.286s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:13 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d is being set with open permissions: ugo+rw Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:13 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d Sep 09 14:59:13 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:13 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d" returned: 0 in 0.248s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:13 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info Sep 09 14:59:13 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:13 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:13 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info is being set with open permissions: ugo+rw Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:13 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info Sep 09 14:59:13 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:13 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.info" returned: 0 in 0.242s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.870s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421784117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d88f510-a4a6-4324-b709-3581dc81511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a610750eee1499fae8f9643083b85d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:11Z,use_quota=True,user_id='60e62265c2bc498eac22e9eea63a0255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Creating volume 8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:13 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:13 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b 1073741824 Sep 09 14:59:13 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-52a76aa3-7d03-42db-aaec-93986fbb1d53 tempest-CinderUnicodeTest-432213698 None] Create snapshot completed successfully Sep 09 14:59:14 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b 1073741824" returned: 0 in 0.406s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:14 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b Sep 09 14:59:14 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-695d6733-2dc6-42b9-8bd7-486e25ef963d-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-695d6733-2dc6-42b9-8bd7-486e25ef963d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-quobyte-8f1f013e-0284-4882-a289-5ada5f379625" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-8f1f013e-0284-4882-a289-5ada5f379625" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-quobyte-695d6733-2dc6-42b9-8bd7-486e25ef963d" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:14 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-695d6733-2dc6-42b9-8bd7-486e25ef963d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Deleting offline snapshot 695d6733-2dc6-42b9-8bd7-486e25ef963d of volume 8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] snapshot_file for this snap is: volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b" returned: 0 in 0.276s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.272s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d95cac-fe0a-4a78-bfd6-cdd6c295188b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a07bc8-0dad-4e56-96cd-ea9ff50b19da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d88f510-a4a6-4324-b709-3581dc81511b', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32be040f-7018-4a33-8541-d45c84a96aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 5943bb5b-8bac-40a5-a472-b025bac641de of volume c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:14 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Volume volume-8d88f510-a4a6-4324-b709-3581dc81511b (8d88f510-a4a6-4324-b709-3581dc81511b): created successfully Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32be040f-7018-4a33-8541-d45c84a96aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Flow 'volume_create_manager' (fc321d1c-46de-4a63-8e86-78115f123e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd531d88-1425-4a38-82ad-aaff1acb848e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:14 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-930737a2-3320-4a80-86be-5a80b98466fb tempest-ProjectReaderTests-803268646 None] Created volume successfully. Sep 09 14:59:14 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d Sep 09 14:59:14 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:14 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b Sep 09 14:59:14 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:14 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f1f013e-0284-4882-a289-5ada5f379625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b7bed-9e33-4b7c-bfef-5187f0b04858]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:15 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" returned: 0 in 0.405s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:15 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de 1G Sep 09 14:59:15 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:15 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 Sep 09 14:59:15 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:15 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625" returned: 0 in 0.399s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:15 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d Sep 09 14:59:15 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:15 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de 1G" returned: 0 in 0.428s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:15 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de Sep 09 14:59:15 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:15 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d" returned: 0 in 0.352s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:15 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d Sep 09 14:59:15 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:15 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:15 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de is being set with open permissions: ugo+rw Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:15 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de Sep 09 14:59:15 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:15 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625.695d6733-2dc6-42b9-8bd7-486e25ef963d" returned: 0 in 0.249s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:15 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-695d6733-2dc6-42b9-8bd7-486e25ef963d" released by "_delete_snapshot" :: held 1.492s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-8f1f013e-0284-4882-a289-5ada5f379625" released by "delete_snapshot" :: held 1.519s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:16 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:16 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info Sep 09 14:59:16 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Created reservations ['fcea78e2-ea45-4af1-aa7e-5e9eb4e6a199', '44d47c07-afad-438b-acdd-c89aa920cac9', '639fff36-8606-46b8-a16d-66b99efcddf2', '37373c71-d71d-4320-a753-fc7825283a31'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Delete snapshot completed successfully. Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-a154fc69-0534-47eb-a424-78ec8da3aa55 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-695d6733-2dc6-42b9-8bd7-486e25ef963d-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:16 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info" returned: 0 in 0.251s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:16 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info is being set with open permissions: ugo+rw Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:16 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info Sep 09 14:59:16 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:16 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.info" returned: 0 in 0.246s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.965s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-quobyte-a7584fcb-fc66-461d-8bac-3a2284236920-8894cc63-645f-4b86-bb18-baf640c9b987" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-a7584fcb-fc66-461d-8bac-3a2284236920-8894cc63-645f-4b86-bb18-baf640c9b987" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Creating volume 8894cc63-645f-4b86-bb18-baf640c9b987 from snapshot a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-quobyte-8894cc63-645f-4b86-bb18-baf640c9b987" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-8f1f013e-0284-4882-a289-5ada5f379625-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:16 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-fdf74297-83a5-4ef7-a3be-3617337c7df3 tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-8894cc63-645f-4b86-bb18-baf640c9b987" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] snapshot: a7584fcb-fc66-461d-8bac-3a2284236920, volume: 8894cc63-645f-4b86-bb18-baf640c9b987, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-8f1f013e-0284-4882-a289-5ada5f379625-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[da24735d-4105-4650-be49-70c89b35b0fe]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-quobyte-8f1f013e-0284-4882-a289-5ada5f379625" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-8f1f013e-0284-4882-a289-5ada5f379625" acquired by "delete_volume" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[762cc931-078c-449d-958c-5149965de920]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:16 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:16 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 Sep 09 14:59:16 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:16 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 Sep 09 14:59:16 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:17 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920" returned: 0 in 0.379s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722456ab-64a4-4e46-838b-e01854d2be43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd777b0-690c-449b-969c-66f782a4ab3d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:17 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625" returned: 0 in 0.368s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:17 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625 Sep 09 14:59:17 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 Sep 09 14:59:17 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:17 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:17 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8f1f013e-0284-4882-a289-5ada5f379625" returned: 0 in 0.248s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-8f1f013e-0284-4882-a289-5ada5f379625" released by "delete_volume" :: held 0.676s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:17 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43" returned: 0 in 0.390s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-5943bb5b-8bac-40a5-a472-b025bac641de-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Created reservations ['3f75e676-aaee-411e-b6e5-da99b1b42122', '7fa9f6ed-aa63-4c1e-a211-d100135ae63b', '846b38af-2bb3-47b3-be82-66c3755976db', '6d926413-7f4d-408a-9e4e-1624c686f618'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:17 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 Sep 09 14:59:17 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Lock "cinder-5943bb5b-8bac-40a5-a472-b025bac641de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-5943bb5b-8bac-40a5-a472-b025bac641de" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-5943bb5b-8bac-40a5-a472-b025bac641de" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 5943bb5b-8bac-40a5-a472-b025bac641de of volume c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[40740ad6-447b-4f43-8282-969d6107ae7b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:17 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:17 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:17 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de Sep 09 14:59:17 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Lock "cinder-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Acquiring lock "cinder-quobyte-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ce84c-54b8-4467-aad7-9b83f09f9644]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:17 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.317s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:17 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:17 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Deleted volume successfully. Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-aebdd70a-eb3f-4826-b6e7-9bb26db46826 tempest-CinderUnicodeTest-432213698 None] Lock "cinder-8f1f013e-0284-4882-a289-5ada5f379625-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:18 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e Sep 09 14:59:18 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:18 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de" returned: 0 in 0.459s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb01ba0a-d060-476f-863a-c325e0da88d5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:18 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b Sep 09 14:59:18 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:18 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e" returned: 0 in 0.545s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:18 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:18 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e Sep 09 14:59:18 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:19 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e" returned: 0 in 0.723s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Lock "cinder-quobyte-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e" released by "delete_volume" :: held 1.335s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:19 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" returned: 0 in 1.176s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:19 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de Sep 09 14:59:19 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Created reservations ['d17368f5-87e5-4c0c-bc65-1e3e84994ade', '16462d69-c0c4-43a0-85a6-6566fd0211b0', '2fc09a4f-b85d-4566-8068-0567e21b970d', 'c3ed6da3-ea88-4a3d-b883-8fa9ee6cea92'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:19 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:19 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:19 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.415s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:19 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Deleted volume successfully. Sep 09 14:59:20 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-d49bbdf5-cc4e-476a-9a0b-a28b4269668c tempest-CinderUnicodeTest-432213698 None] Lock "cinder-dcf3b1d6-032e-4b18-ad9c-24ce60c62b1e-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:20 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de" returned: 0 in 1.132s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:20 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de Sep 09 14:59:20 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:21 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b.5943bb5b-8bac-40a5-a472-b025bac641de" returned: 0 in 0.658s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-5943bb5b-8bac-40a5-a472-b025bac641de" released by "_delete_snapshot" :: held 3.591s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" released by "delete_snapshot" :: held 3.631s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:21 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Created reservations ['b9c79ce8-a221-4412-95cc-4f3cc83764ba', 'ee73ba68-cece-4701-89db-9ecc3fdd86ce', '52d50e54-4a81-498f-99b5-e9bb1db3537e', '1651c938-23aa-4976-a8e4-76e9837670e7'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:21 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 14:59:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f58385c8-9039-4c61-ba46-d3363edeca6d tempest-ProjectMemberTests-220436694 None] Lock "cinder-5943bb5b-8bac-40a5-a472-b025bac641de-delete_snapshot" released by "delete_snapshot" :: held 3.960s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-c411d807-2a92-49a7-9cdc-2d3658ff7b1b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Lock "cinder-c411d807-2a92-49a7-9cdc-2d3658ff7b1b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" acquired by "delete_volume" :: waited 0.047s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca370e8-d19a-4a80-a44f-9a922bc1e5a2]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:22 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b Sep 09 14:59:22 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:22 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987" returned: 0 in 5.393s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 14:59:22 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Converted 1024.00 MB image at 189.79 MB/s Sep 09 14:59:22 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 is being set with open permissions: ugo+rw Sep 09 14:59:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:22 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 Sep 09 14:59:22 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:23 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" returned: 0 in 0.718s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:23 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b Sep 09 14:59:23 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:23 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987" returned: 0 in 0.295s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-8894cc63-645f-4b86-bb18-baf640c9b987" released by "_copy_volume_from_snapshot" :: held 6.569s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-a7584fcb-fc66-461d-8bac-3a2284236920-8894cc63-645f-4b86-bb18-baf640c9b987" released by "_create_volume_from_snapshot" :: held 6.662s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.690s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.059s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Creating offline snapshot a0669923-d5d9-4ab6-965e-fe70680fb521 of volume 8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b907b66-7b3f-4c93-a42f-158fb24611d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8894cc63-645f-4b86-bb18-baf640c9b987', 'volume_size': 1, 'snapshot_id': 'a7584fcb-fc66-461d-8bac-3a2284236920'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4001ba72-bdb2-49e7-94cc-076ed6aaba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2947954f-12d4-409a-a69c-6d1b77991979]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:23 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Volume volume-8894cc63-645f-4b86-bb18-baf640c9b987 (8894cc63-645f-4b86-bb18-baf640c9b987): created successfully Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4001ba72-bdb2-49e7-94cc-076ed6aaba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:23 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Flow 'volume_create_manager' (1b16145e-800e-4399-b2cc-b6766e653c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" returned: 0 in 0.319s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-c411d807-2a92-49a7-9cdc-2d3658ff7b1b" released by "delete_volume" :: held 1.186s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9886c3cd-d83c-4a13-9775-893fd04da42d tempest-VolumeDependencyTests-323332019 None] Created volume successfully. Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Created reservations ['671c4dc4-9902-4f64-877e-37a3291fc76e', 'a8891677-fa83-4aef-b2c4-2b628e657679', '71b4ffae-183a-493b-a3c1-ffc7e96e006f', 'cb423fcb-f20b-4b4e-b4cc-4fecb100055e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:23 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b Sep 09 14:59:23 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:23 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:23 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-a7584fcb-fc66-461d-8bac-3a2284236920-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-a7584fcb-fc66-461d-8bac-3a2284236920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-quobyte-722456ab-64a4-4e46-838b-e01854d2be43" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-722456ab-64a4-4e46-838b-e01854d2be43" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-quobyte-a7584fcb-fc66-461d-8bac-3a2284236920" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:23 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b" returned: 0 in 0.422s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-a7584fcb-fc66-461d-8bac-3a2284236920" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Deleting offline snapshot a7584fcb-fc66-461d-8bac-3a2284236920 of volume 722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:23 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 1G Sep 09 14:59:23 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] snapshot_file for this snap is: volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f131cf6-c09f-40c6-ba92-71b3b36d7f61]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:23 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.358s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 14:59:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a60f28f-7c89-4c89-bee8-86d5389b2dd6 tempest-ProjectMemberTests-220436694 None] Lock "cinder-c411d807-2a92-49a7-9cdc-2d3658ff7b1b-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:23 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 Sep 09 14:59:23 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:24 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 1G" returned: 0 in 0.464s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d88f510-a4a6-4324-b709-3581dc81511b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:24 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d88f510-a4a6-4324-b709-3581dc81511b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 Sep 09 14:59:24 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:24 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920" returned: 0 in 0.444s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722456ab-64a4-4e46-838b-e01854d2be43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e8d96-b232-4284-a912-070806ee83ac]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:24 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 Sep 09 14:59:24 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:24 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d88f510-a4a6-4324-b709-3581dc81511b -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521" returned: 0 in 0.346s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:24 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 is being set with open permissions: ugo+rw Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:24 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 Sep 09 14:59:24 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:24 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:24 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info Sep 09 14:59:24 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:24 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43" returned: 0 in 0.692s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:25 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 Sep 09 14:59:25 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (288b474d-3372-4e61-9fdb-418ad4a6c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccd9312-01bf-476b-81c6-b7b990413c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccd9312-01bf-476b-81c6-b7b990413c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079438500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02466d83-fc5c-4699-acb8-afca14f832ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:25Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867b5548-5d25-4205-ac38-9143752419e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867b5548-5d25-4205-ac38-9143752419e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241fc28a-ee94-4ebf-8707-35fafc00516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241fc28a-ee94-4ebf-8707-35fafc00516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02466d83-fc5c-4699-acb8-afca14f832ba', 'volume_name': 'volume-02466d83-fc5c-4699-acb8-afca14f832ba', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bff563-7a9c-4e71-a53d-923c9b96ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bff563-7a9c-4e71-a53d-923c9b96ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408dc49d-bb56-417c-9f4a-3ff3c6c89121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:25 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Volume 02466d83-fc5c-4699-acb8-afca14f832ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02466d83-fc5c-4699-acb8-afca14f832ba', 'volume_size': 1} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0a688fba-bc85-49a4-8a1b-ac790172ad93 tempest-ProjectAdminTests-748405251 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3789901733398, 'free_capacity_gb': 1773.3789901733398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87325) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 14:59:25 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info" returned: 0 in 0.327s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:25 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info is being set with open permissions: ugo+rw Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:25 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info Sep 09 14:59:25 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:25 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920" returned: 0 in 0.454s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:25 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920 Sep 09 14:59:25 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:25 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.info" returned: 0 in 0.265s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079438500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02466d83-fc5c-4699-acb8-afca14f832ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:25Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Creating volume 02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:25 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:25 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba 1073741824 Sep 09 14:59:25 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-482ca358-1a25-44e3-a3a6-c9e2b4a34d6e tempest-ProjectReaderTests-803268646 None] Create snapshot completed successfully Sep 09 14:59:25 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43.a7584fcb-fc66-461d-8bac-3a2284236920" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-a7584fcb-fc66-461d-8bac-3a2284236920" released by "_delete_snapshot" :: held 2.009s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-722456ab-64a4-4e46-838b-e01854d2be43" released by "delete_snapshot" :: held 2.066s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Created reservations ['5227c483-1e94-4530-95d9-7f1c830411dc', 'a10c530f-f467-4b6d-9c17-7a570bb96a87', '09984fdf-0ab7-46a7-a5d0-44da002f678d', 'eb27f345-2565-43a4-9353-9e3914aecbb7'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Delete snapshot completed successfully. Sep 09 14:59:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-382a921e-55d6-4002-ad23-c8f36f2a07e5 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-a7584fcb-fc66-461d-8bac-3a2284236920-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-a0669923-d5d9-4ab6-965e-fe70680fb521-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Lock "cinder-a0669923-d5d9-4ab6-965e-fe70680fb521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-8d88f510-a4a6-4324-b709-3581dc81511b" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-8d88f510-a4a6-4324-b709-3581dc81511b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-a0669923-d5d9-4ab6-965e-fe70680fb521" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-a0669923-d5d9-4ab6-965e-fe70680fb521" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Deleting offline snapshot a0669923-d5d9-4ab6-965e-fe70680fb521 of volume 8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] snapshot_file for this snap is: volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[169274e3-de64-4108-97a8-a3f588fbf79c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:26 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba 1073741824" returned: 0 in 0.615s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:26 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 Sep 09 14:59:26 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:26 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba Sep 09 14:59:26 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:26 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521" returned: 0 in 0.421s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d88f510-a4a6-4324-b709-3581dc81511b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:26 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba" returned: 0 in 0.304s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c849314-1706-4db8-b45c-9db5716bff84]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408dc49d-bb56-417c-9f4a-3ff3c6c89121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02466d83-fc5c-4699-acb8-afca14f832ba', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f11a32b-74e2-4eed-afac-bedecd0afd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:26 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Volume volume-02466d83-fc5c-4699-acb8-afca14f832ba (02466d83-fc5c-4699-acb8-afca14f832ba): created successfully Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f11a32b-74e2-4eed-afac-bedecd0afd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (288b474d-3372-4e61-9fdb-418ad4a6c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:26 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-69ae5872-d55c-4e4c-959e-69995f620433 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:59:26 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b Sep 09 14:59:26 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-722456ab-64a4-4e46-838b-e01854d2be43-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Lock "cinder-722456ab-64a4-4e46-838b-e01854d2be43-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-quobyte-722456ab-64a4-4e46-838b-e01854d2be43" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:27 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b" returned: 0 in 0.426s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-722456ab-64a4-4e46-838b-e01854d2be43" acquired by "delete_volume" :: waited 0.028s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:27 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 Sep 09 14:59:27 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d02c7-021b-4bc0-98a4-64b61182de50]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:27 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 Sep 09 14:59:27 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 338f2812-50be-4110-bdcb-0cf10003ea6d of volume 02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eb0a9a-9daf-4b31-9fde-9c38d73c2a50]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:27 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521" returned: 0 in 0.449s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:27 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521 Sep 09 14:59:27 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:27 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba Sep 09 14:59:27 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:27 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43" returned: 0 in 0.491s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:27 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43 Sep 09 14:59:27 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:27 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b.a0669923-d5d9-4ab6-965e-fe70680fb521" returned: 0 in 0.286s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-a0669923-d5d9-4ab6-965e-fe70680fb521" released by "_delete_snapshot" :: held 1.695s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-8d88f510-a4a6-4324-b709-3581dc81511b" released by "delete_snapshot" :: held 1.721s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:27 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba" returned: 0 in 0.429s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:27 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:27 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d 1G Sep 09 14:59:27 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Created reservations ['08214bbe-cb90-42b9-bc2f-0e5a4d3ee684', '4f946e22-3f17-486f-8260-570fef9fb337', 'ad1244f3-f805-41bc-a31c-a0de05e170ab', '6a6472b5-40c0-43f4-9224-2797daa04699'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-722456ab-64a4-4e46-838b-e01854d2be43" returned: 0 in 0.319s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-722456ab-64a4-4e46-838b-e01854d2be43" released by "delete_volume" :: held 0.902s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Delete snapshot completed successfully. Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7f760f9f-ffe9-4ea8-be48-caf88d9dd882 tempest-ProjectReaderTests-803268646 None] Lock "cinder-a0669923-d5d9-4ab6-965e-fe70680fb521-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Created reservations ['50e81ecc-d006-4c8b-9a3b-c98a39df9e32', 'a11972bd-880b-41a3-a1aa-cfa513231cfc', 'efdefc67-831d-4702-bfc8-a088d7b78cce', 'ef4f55ed-8844-46f4-b03b-91572e4e7415'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:28 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:28 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-8d88f510-a4a6-4324-b709-3581dc81511b-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Lock "cinder-8d88f510-a4a6-4324-b709-3581dc81511b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Acquiring lock "cinder-quobyte-8d88f510-a4a6-4324-b709-3581dc81511b" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-8d88f510-a4a6-4324-b709-3581dc81511b" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:28 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d 1G" returned: 0 in 0.557s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02466d83-fc5c-4699-acb8-afca14f832ba -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e9f36-3afb-4d60-af16-2b83ffa6d792]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:28 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02466d83-fc5c-4699-acb8-afca14f832ba -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d Sep 09 14:59:28 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:28 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.364s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:28 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Deleted volume successfully. Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-17757bb1-8232-417b-9ccd-ec53d5ee1b8a tempest-VolumeDependencyTests-323332019 None] Lock "cinder-722456ab-64a4-4e46-838b-e01854d2be43-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:28 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b Sep 09 14:59:28 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:28 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02466d83-fc5c-4699-acb8-afca14f832ba -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d" returned: 0 in 0.340s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:28 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d is being set with open permissions: ugo+rw Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:28 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d Sep 09 14:59:28 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:28 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b" returned: 0 in 0.421s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:28 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:28 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b Sep 09 14:59:28 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:29 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d" returned: 0 in 0.261s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:29 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8d88f510-a4a6-4324-b709-3581dc81511b" returned: 0 in 0.262s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Lock "cinder-quobyte-8d88f510-a4a6-4324-b709-3581dc81511b" released by "delete_volume" :: held 0.776s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Created reservations ['4982ab5f-c460-4744-b899-481a3d5357a7', '9128af5e-0f88-4a6f-981d-861fc5f25b77', '2194e6cb-b432-400d-a8e9-62bd6cb43ef3', 'e2ac0230-387d-4cbc-b802-e4df5e6c40bd'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:29 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info Sep 09 14:59:29 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:29 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info" returned: 0 in 0.248s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:29 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info is being set with open permissions: ugo+rw Sep 09 14:59:29 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:29 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info Sep 09 14:59:29 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-8894cc63-645f-4b86-bb18-baf640c9b987-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-8894cc63-645f-4b86-bb18-baf640c9b987-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:30 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.info" returned: 0 in 0.266s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "cinder-quobyte-8894cc63-645f-4b86-bb18-baf640c9b987" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-8894cc63-645f-4b86-bb18-baf640c9b987" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4208882a-cc24-4caa-907f-4cc08676a2e7]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8364965d-2289-42b7-b60f-7c3f36a338e1 tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 14:59:30 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 Sep 09 14:59:30 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:30 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:30 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:30 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987" returned: 0 in 0.376s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:30 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987 Sep 09 14:59:30 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:30 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:30 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Deleted volume successfully. Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-dbbebf05-357f-445d-ad8a-c523ef80679e tempest-ProjectReaderTests-803268646 None] Lock "cinder-8d88f510-a4a6-4324-b709-3581dc81511b-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:30 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8894cc63-645f-4b86-bb18-baf640c9b987" returned: 0 in 0.274s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:30 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-quobyte-8894cc63-645f-4b86-bb18-baf640c9b987" released by "delete_volume" :: held 0.691s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Created reservations ['ece95f57-4834-4d6b-8d4e-a74dfd425583', '41e0a31b-4bd3-4ef3-b735-5658e6ed138f', '326718a2-a18f-4021-9f66-e23b81afd74f', '8bd917b2-9b56-4c2d-a625-9b676b41f110'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-338f2812-50be-4110-bdcb-0cf10003ea6d-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Lock "cinder-338f2812-50be-4110-bdcb-0cf10003ea6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-02466d83-fc5c-4699-acb8-afca14f832ba" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-02466d83-fc5c-4699-acb8-afca14f832ba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-338f2812-50be-4110-bdcb-0cf10003ea6d" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-338f2812-50be-4110-bdcb-0cf10003ea6d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 338f2812-50be-4110-bdcb-0cf10003ea6d of volume 02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6892680-eece-4a36-831c-8cb10356df6c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:31 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:31 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:31 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d Sep 09 14:59:31 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:31 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.245s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:31 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Deleted volume successfully. Sep 09 14:59:31 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d" returned: 0 in 0.382s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02466d83-fc5c-4699-acb8-afca14f832ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a07b890-6c82-48c5-b870-ad8d7676c240]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:31 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ee32e64b-bf61-433a-bd38-3f6837093e79 tempest-VolumeDependencyTests-323332019 None] Lock "cinder-8894cc63-645f-4b86-bb18-baf640c9b987-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:31 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba Sep 09 14:59:31 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:32 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:32 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d Sep 09 14:59:32 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:32 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d" returned: 0 in 0.391s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:32 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d Sep 09 14:59:32 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:32 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba.338f2812-50be-4110-bdcb-0cf10003ea6d" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-338f2812-50be-4110-bdcb-0cf10003ea6d" released by "_delete_snapshot" :: held 1.502s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:32 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-02466d83-fc5c-4699-acb8-afca14f832ba" released by "delete_snapshot" :: held 1.532s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:33 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Created reservations ['e042dc9d-566a-4f86-af6e-ed4f40a2d840', '943a960d-b1f7-4990-b2aa-673e2cc2cd42', '5dec524e-3b00-460a-a0a7-29a761faa45e', 'f4a16067-8264-4c2d-bc0e-a6dde268f5c8'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:33 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 14:59:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-40a4ec28-6659-4d0b-a6fa-55a9a3d4da4e tempest-ProjectMemberTests-220436694 None] Lock "cinder-338f2812-50be-4110-bdcb-0cf10003ea6d-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:33 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-02466d83-fc5c-4699-acb8-afca14f832ba-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Lock "cinder-02466d83-fc5c-4699-acb8-afca14f832ba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-02466d83-fc5c-4699-acb8-afca14f832ba" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-02466d83-fc5c-4699-acb8-afca14f832ba" acquired by "delete_volume" :: waited 0.026s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c0306-3154-417a-b386-d093bdef0650]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:34 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba Sep 09 14:59:34 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:34 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba" returned: 0 in 0.387s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:34 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:34 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba Sep 09 14:59:34 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:35 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-02466d83-fc5c-4699-acb8-afca14f832ba" returned: 0 in 0.256s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-02466d83-fc5c-4699-acb8-afca14f832ba" released by "delete_volume" :: held 0.725s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Created reservations ['9990b6f1-59ff-4f54-9ddd-e32588e91802', '9c5f914f-fc0f-4410-9f1d-ede530c4cfba', '46c4adff-0f7a-4b36-ad3a-5483f2cce8f5', '1ce3d956-af7c-46c4-bd03-85ffede9c021'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:35 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:35 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:35 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.286s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:35 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 14:59:35 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-5300c39f-1559-4002-a9d9-88949c8bca96 tempest-ProjectMemberTests-220436694 None] Lock "cinder-02466d83-fc5c-4699-acb8-afca14f832ba-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (4647571d-e6a8-43a3-9443-2d45ce040206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992c3816-8ea0-4ddf-96e3-cdbb1dd866ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992c3816-8ea0-4ddf-96e3-cdbb1dd866ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901527139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a19f208-1c15-4547-b45c-c99b25f0a74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:37Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33796853-70d0-47e6-bfa3-a36683920a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33796853-70d0-47e6-bfa3-a36683920a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffe1644-0cd6-4824-b07d-35a446444fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffe1644-0cd6-4824-b07d-35a446444fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a19f208-1c15-4547-b45c-c99b25f0a74c', 'volume_name': 'volume-8a19f208-1c15-4547-b45c-c99b25f0a74c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d474e5-0233-41d3-9da2-066ae509b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d474e5-0233-41d3-9da2-066ae509b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9385b1-d3f7-4984-b0a3-c2499b7e2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:36 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Volume 8a19f208-1c15-4547-b45c-c99b25f0a74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a19f208-1c15-4547-b45c-c99b25f0a74c', 'volume_size': 1} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901527139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a19f208-1c15-4547-b45c-c99b25f0a74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:37Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Creating volume 8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:36 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:36 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:37 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c 1073741824 Sep 09 14:59:37 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:37 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c 1073741824" returned: 0 in 0.547s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:37 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c Sep 09 14:59:37 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:37 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9385b1-d3f7-4984-b0a3-c2499b7e2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a19f208-1c15-4547-b45c-c99b25f0a74c', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e948120-887c-4386-b324-990b067eb56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:37 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Volume volume-8a19f208-1c15-4547-b45c-c99b25f0a74c (8a19f208-1c15-4547-b45c-c99b25f0a74c): created successfully Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e948120-887c-4386-b324-990b067eb56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:37 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (4647571d-e6a8-43a3-9443-2d45ce040206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:37 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5cb384c6-cfe2-4502-86e7-0252e1605a70 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Flow 'volume_create_manager' (ea5543f5-e8f0-4620-ad4e-12ae8679cffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce07d6c-0a77-4aa9-93f9-9cea6bff0eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce07d6c-0a77-4aa9-93f9-9cea6bff0eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229803324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33905ce8223246b0be471239de5b6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:38Z,use_quota=True,user_id='af0d5c8b61ed49b99b3ccd28526e801a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c874fa-9c94-4242-86be-80b0ed08840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c874fa-9c94-4242-86be-80b0ed08840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b510c0-1f79-4e6a-860d-d8deca2fc445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b510c0-1f79-4e6a-860d-d8deca2fc445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23', 'volume_name': 'volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0db148-a3b7-48e1-a43b-8894dea6de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0db148-a3b7-48e1-a43b-8894dea6de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b4b223-f6a2-489e-9117-b7b5f41f171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:38 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Volume cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23', 'volume_size': 1} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229803324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33905ce8223246b0be471239de5b6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:38Z,use_quota=True,user_id='af0d5c8b61ed49b99b3ccd28526e801a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Creating volume cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:38 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:38 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:38 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 1073741824 Sep 09 14:59:38 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:39 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 1073741824" returned: 0 in 0.579s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:39 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 Sep 09 14:59:39 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:39 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23" returned: 0 in 0.332s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.200s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 079fe18c-4305-4ff0-89ea-93860e129fda of volume 8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b4b223-f6a2-489e-9117-b7b5f41f171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce63cec-c62a-46ff-8396-67c7a80f5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a453dd-3b32-4525-be82-aff849fac76c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:39 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Volume volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 (cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23): created successfully Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce63cec-c62a-46ff-8396-67c7a80f5320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Flow 'volume_create_manager' (ea5543f5-e8f0-4620-ad4e-12ae8679cffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:39 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b8c5be79-532e-44c2-bc71-54801f5ed336 tempest-ProjectReaderTests-1643476011 None] Created volume successfully. Sep 09 14:59:39 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c Sep 09 14:59:39 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:39 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c" returned: 0 in 0.423s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:39 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:39 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda 1G Sep 09 14:59:39 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:40 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda 1G" returned: 0 in 0.530s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a19f208-1c15-4547-b45c-c99b25f0a74c -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:40 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a19f208-1c15-4547-b45c-c99b25f0a74c -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda Sep 09 14:59:40 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "cinder-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:40 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a19f208-1c15-4547-b45c-c99b25f0a74c -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda" returned: 0 in 0.401s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:40 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda is being set with open permissions: ugo+rw Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:40 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda Sep 09 14:59:40 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "cinder-quobyte-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-quobyte-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c3d81-fe36-4be0-b9c8-465121951f8b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:40 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:41 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 Sep 09 14:59:41 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:41 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda" returned: 0 in 0.385s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:41 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info Sep 09 14:59:41 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:41 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23" returned: 0 in 0.459s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:41 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23 Sep 09 14:59:41 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:41 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info" returned: 0 in 0.332s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:41 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info is being set with open permissions: ugo+rw Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:41 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info Sep 09 14:59:41 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:41 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23" returned: 0 in 0.309s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-quobyte-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23" released by "delete_volume" :: held 0.829s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Created reservations ['acaa5bd3-5232-4edf-a628-5521746ebcf3', '71561da0-be0f-4a97-aa00-5577470f201a', '393c2ecd-4df4-42f0-8b3e-2cfea6350b7e', 'f33f13f6-20cf-43f5-96ba-1dae4ba607d8'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:41 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.info" returned: 0 in 0.289s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:41 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7005d775-4afd-4914-b1e7-197243877b98 tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:41 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:42 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:42 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:42 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.327s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:42 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Deleted volume successfully. Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-73058ccb-f3a3-494c-9aae-672102954b80 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-cfdeba4e-dd0e-4a06-ad1a-60b7e3961c23-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-079fe18c-4305-4ff0-89ea-93860e129fda-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-079fe18c-4305-4ff0-89ea-93860e129fda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-8a19f208-1c15-4547-b45c-c99b25f0a74c" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-8a19f208-1c15-4547-b45c-c99b25f0a74c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-079fe18c-4305-4ff0-89ea-93860e129fda" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-079fe18c-4305-4ff0-89ea-93860e129fda" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 079fe18c-4305-4ff0-89ea-93860e129fda of volume 8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d0600-ea97-4f26-beb4-6dc83d72adb5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Flow 'volume_create_manager' (37155c70-d733-4e9b-a619-ca9fee46d3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cd2377-e443-4f24-82eb-59550ee5d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cd2377-e443-4f24-82eb-59550ee5d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160320433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359640b7-af25-481c-942f-ed10f16e0733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33905ce8223246b0be471239de5b6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:43Z,use_quota=True,user_id='af0d5c8b61ed49b99b3ccd28526e801a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb58202-be59-418e-bad6-430ecda11ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb58202-be59-418e-bad6-430ecda11ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b03126-75a0-4c86-bffc-62b318d0db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b03126-75a0-4c86-bffc-62b318d0db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359640b7-af25-481c-942f-ed10f16e0733', 'volume_name': 'volume-359640b7-af25-481c-942f-ed10f16e0733', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad533b8-bd33-4304-81e8-9dac042bd04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad533b8-bd33-4304-81e8-9dac042bd04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6cc33e-aacd-4327-b754-5681f37fd538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:42 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Volume 359640b7-af25-481c-942f-ed10f16e0733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359640b7-af25-481c-942f-ed10f16e0733', 'volume_size': 1} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160320433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359640b7-af25-481c-942f-ed10f16e0733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33905ce8223246b0be471239de5b6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:43Z,use_quota=True,user_id='af0d5c8b61ed49b99b3ccd28526e801a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Creating volume 359640b7-af25-481c-942f-ed10f16e0733 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:42 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:42 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:42 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda Sep 09 14:59:42 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:42 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 1073741824 Sep 09 14:59:42 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:43 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda" returned: 0 in 0.455s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a19f208-1c15-4547-b45c-c99b25f0a74c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[54699f80-9520-45ed-89b7-3e3527d5ef3b]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:43 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c Sep 09 14:59:43 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:43 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 1073741824" returned: 0 in 0.544s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:43 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 Sep 09 14:59:43 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:43 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c" returned: 0 in 0.541s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:43 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda Sep 09 14:59:43 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:43 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6cc33e-aacd-4327-b754-5681f37fd538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359640b7-af25-481c-942f-ed10f16e0733', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7ac4e7-d1e2-4c7f-9d1b-d67aeaa5a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:43 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Volume volume-359640b7-af25-481c-942f-ed10f16e0733 (359640b7-af25-481c-942f-ed10f16e0733): created successfully Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7ac4e7-d1e2-4c7f-9d1b-d67aeaa5a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:43 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Flow 'volume_create_manager' (37155c70-d733-4e9b-a619-ca9fee46d3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:43 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-db01e192-b1e8-4918-9a7f-584720854db8 tempest-ProjectReaderTests-1643476011 None] Created volume successfully. Sep 09 14:59:44 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda" returned: 0 in 0.411s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:44 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda Sep 09 14:59:44 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:44 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c.079fe18c-4305-4ff0-89ea-93860e129fda" returned: 0 in 0.253s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-079fe18c-4305-4ff0-89ea-93860e129fda" released by "_delete_snapshot" :: held 1.793s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-8a19f208-1c15-4547-b45c-c99b25f0a74c" released by "delete_snapshot" :: held 1.832s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Created reservations ['fc17ffbc-1e63-409d-852a-8122a013f569', 'b7aa4d34-0575-432b-a6d4-b9ca1195a1fd', '299adc4f-b26f-46fe-b57e-6468be4ab64c', 'be91de1c-4381-4312-b734-1929c08a895e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:44 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-9780d5cc-ce1b-40a5-ae35-7896114a4ee3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-079fe18c-4305-4ff0-89ea-93860e129fda-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "cinder-359640b7-af25-481c-942f-ed10f16e0733-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-359640b7-af25-481c-942f-ed10f16e0733-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-8a19f208-1c15-4547-b45c-c99b25f0a74c-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Lock "cinder-8a19f208-1c15-4547-b45c-c99b25f0a74c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "cinder-quobyte-359640b7-af25-481c-942f-ed10f16e0733" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-8a19f208-1c15-4547-b45c-c99b25f0a74c" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-quobyte-359640b7-af25-481c-942f-ed10f16e0733" acquired by "delete_volume" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-8a19f208-1c15-4547-b45c-c99b25f0a74c" acquired by "delete_volume" :: waited 0.038s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3486c-00c0-4bfe-a8f0-fef629bdcb0e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bada596-4056-4871-914c-d32a091b6c39]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:45 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c Sep 09 14:59:45 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:45 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 Sep 09 14:59:45 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:45 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c" returned: 0 in 0.446s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:45 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733" returned: 0 in 0.478s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:45 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c Sep 09 14:59:45 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:45 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733 Sep 09 14:59:45 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:45 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-8a19f208-1c15-4547-b45c-c99b25f0a74c" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-8a19f208-1c15-4547-b45c-c99b25f0a74c" released by "delete_volume" :: held 0.837s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Created reservations ['04bce833-7c0d-4396-9b93-ce9a8db49828', '6b44bf6f-7355-4274-88b4-c00dff607f4f', 'fcfc0756-742e-4e8a-b580-a1b883cd8a1d', 'f5e41f5a-6ce1-4041-a1d3-363cbbec62ac'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:45 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-359640b7-af25-481c-942f-ed10f16e0733" returned: 0 in 0.386s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-quobyte-359640b7-af25-481c-942f-ed10f16e0733" released by "delete_volume" :: held 0.961s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:45 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Created reservations ['f9921c52-6fa6-4a8f-861b-acead56f3b91', '38f89934-c2af-45e3-9f29-7c4e02322853', '8da88488-881b-40fb-bb89-ab999030b0c0', 'd515976f-e3ff-48be-9c9b-0f31df15045d'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:45 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:45 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:46 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:46 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:46 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ebce0817-3c0b-41cd-a7c1-ee755ddea4c7 tempest-ProjectMemberTests-220436694 None] Lock "cinder-8a19f208-1c15-4547-b45c-c99b25f0a74c-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:46 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.474s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Deleted volume successfully. Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c2e62dce-5a01-438e-9963-b43918a7d785 tempest-ProjectReaderTests-1643476011 None] Lock "cinder-359640b7-af25-481c-942f-ed10f16e0733-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (defe9435-3a62-4e0a-926d-e215247f9611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8207bd9f-f8d9-4741-b3a8-3fa6bfb6859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8207bd9f-f8d9-4741-b3a8-3fa6bfb6859a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320596889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d34a9e-a3ac-4c2d-bd86-5e335ccd7680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:47Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f59b4fb-871e-4240-aa1f-a859771c9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f59b4fb-871e-4240-aa1f-a859771c9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0556c2-6236-404b-a919-0c396ab228c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0556c2-6236-404b-a919-0c396ab228c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d34a9e-a3ac-4c2d-bd86-5e335ccd7680', 'volume_name': 'volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e402692a-4551-4246-b4fd-a35352317963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e402692a-4551-4246-b4fd-a35352317963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcbbf40-65ef-44ff-b611-c68b117ac99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:46 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Volume 15d34a9e-a3ac-4c2d-bd86-5e335ccd7680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680', 'volume_size': 1} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320596889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d34a9e-a3ac-4c2d-bd86-5e335ccd7680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:47Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Creating volume 15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:46 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:46 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 1073741824 Sep 09 14:59:46 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:47 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 1073741824" returned: 0 in 0.489s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:47 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 Sep 09 14:59:47 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:47 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" returned: 0 in 0.313s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcbbf40-65ef-44ff-b611-c68b117ac99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7358eaf9-74c0-4923-9c7b-53f2aa5da0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Volume volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 (15d34a9e-a3ac-4c2d-bd86-5e335ccd7680): created successfully Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7358eaf9-74c0-4923-9c7b-53f2aa5da0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (defe9435-3a62-4e0a-926d-e215247f9611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:47 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b0e3a49f-6234-44e0-972c-274b8260ee00 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 1b5a3ce7-e973-436c-98fd-dd063eef6754 of volume 15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae56ea-122f-4bd7-8fa3-452679e73a46]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:49 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 Sep 09 14:59:49 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:49 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" returned: 0 in 0.473s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:49 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 1G Sep 09 14:59:49 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:50 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 1G" returned: 0 in 0.680s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:50 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 Sep 09 14:59:50 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:50 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754" returned: 0 in 0.333s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:50 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 is being set with open permissions: ugo+rw Sep 09 14:59:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:50 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 Sep 09 14:59:50 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:50 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:50 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info Sep 09 14:59:50 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:51 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info" returned: 0 in 0.304s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:51 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info is being set with open permissions: ugo+rw Sep 09 14:59:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:51 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info Sep 09 14:59:51 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:51 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.info" returned: 0 in 0.284s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-06e360e4-f8ee-40b7-9c95-ccf7feeb459c tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-1b5a3ce7-e973-436c-98fd-dd063eef6754-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Lock "cinder-1b5a3ce7-e973-436c-98fd-dd063eef6754-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:52 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:52 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-1b5a3ce7-e973-436c-98fd-dd063eef6754" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-1b5a3ce7-e973-436c-98fd-dd063eef6754" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 1b5a3ce7-e973-436c-98fd-dd063eef6754 of volume 15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f2025-1341-46a6-aec6-047e543949e8]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:52 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 Sep 09 14:59:52 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:52 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 14:59:52 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754" returned: 0 in 0.440s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 14:59:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c9324-ae9f-44dc-add6-05915d156d44]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:53 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 Sep 09 14:59:53 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:53 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" returned: 0 in 0.402s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:53 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 Sep 09 14:59:53 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:53 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754" returned: 0 in 0.398s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:53 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754 Sep 09 14:59:53 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:54 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680.1b5a3ce7-e973-436c-98fd-dd063eef6754" returned: 0 in 0.311s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-1b5a3ce7-e973-436c-98fd-dd063eef6754" released by "_delete_snapshot" :: held 1.711s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" released by "delete_snapshot" :: held 1.757s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Created reservations ['6ca72a34-4f89-4197-b5d2-d66c4bf141e1', 'ed00ebb9-51fc-4f91-baaa-facafc4bca22', '65c47bdb-8b34-476d-82ef-b2d7ffcee252', 'f99295b1-e3a9-469a-a0bf-bda8ef174d24'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:54 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-25d5a5b6-7f7b-4e83-b96a-7a82f307b12a tempest-ProjectMemberTests-220436694 None] Lock "cinder-1b5a3ce7-e973-436c-98fd-dd063eef6754-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Lock "cinder-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" acquired by "delete_volume" :: waited 0.022s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba975cd-6c45-481f-b437-7cd3005bf2f5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:54 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 Sep 09 14:59:54 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:55 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" returned: 0 in 0.372s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:55 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680 Sep 09 14:59:55 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:55 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" returned: 0 in 0.367s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680" released by "delete_volume" :: held 0.816s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Created reservations ['e6296287-8776-4776-b7f3-77a429009bad', 'ce21f40a-7fac-4e5d-a895-fcae14e87c74', 'cdfee381-336a-4c34-b5bc-6defc833f025', '654fcade-ccdc-4a36-8f6b-c8c93b4f58ee'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:55 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 14:59:55 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:55 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.347s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:55 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 14:59:55 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2a69e635-4352-408d-80a3-00ac6c2fc741 tempest-ProjectMemberTests-220436694 None] Lock "cinder-15d34a9e-a3ac-4c2d-bd86-5e335ccd7680-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (c66a1f80-81d7-482c-a1c8-fb34eaeb1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87511ee-0e86-4eef-b660-450ded560834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87511ee-0e86-4eef-b660-450ded560834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234004586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f23bd5f-127c-4d2a-adef-26638f78c1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:56Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb34897-a811-40b2-9961-332c57ed313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb34897-a811-40b2-9961-332c57ed313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4570cdc8-a19b-4164-8bec-f75a054cd322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4570cdc8-a19b-4164-8bec-f75a054cd322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f23bd5f-127c-4d2a-adef-26638f78c1d4', 'volume_name': 'volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9969516-f328-4ce7-be23-f40d15b42516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9969516-f328-4ce7-be23-f40d15b42516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28b0c9a-939e-46d9-a53f-6330bd723216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:56 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Volume 2f23bd5f-127c-4d2a-adef-26638f78c1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4', 'volume_size': 1} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T12:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234004586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f23bd5f-127c-4d2a-adef-26638f78c1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T12:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T12:59:56Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Creating volume 2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 14:59:56 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 14:59:56 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:56 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 1073741824 Sep 09 14:59:56 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:57 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 1073741824" returned: 0 in 0.583s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:57 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 Sep 09 14:59:57 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:57 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4" returned: 0 in 0.298s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28b0c9a-939e-46d9-a53f-6330bd723216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0d3a72-6896-46d1-bf3a-767b88e8d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 14:59:57 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Volume volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 (2f23bd5f-127c-4d2a-adef-26638f78c1d4): created successfully Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0d3a72-6896-46d1-bf3a-767b88e8d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 14:59:57 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (c66a1f80-81d7-482c-a1c8-fb34eaeb1a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 14:59:57 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-db25b011-0e22-4870-b9d7-e3878e2a2749 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 14:59:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 14:59:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 14:59:58 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 11f5d3fc-ebc0-4e26-b2cc-a84667525809 of volume 2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 14:59:58 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5fddde-fe47-46df-b9e7-f877a3ba2cca]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 14:59:58 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:59 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 Sep 09 14:59:59 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:59 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4" returned: 0 in 0.412s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:59 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 1G Sep 09 14:59:59 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 14:59:59 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 09 14:59:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 1G" returned: 0 in 0.419s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 14:59:59 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 14:59:59 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 Sep 09 14:59:59 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:00 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809" returned: 0 in 0.343s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:00 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 is being set with open permissions: ugo+rw Sep 09 15:00:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:00 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 Sep 09 15:00:00 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:00 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809" returned: 0 in 0.307s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:00 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info Sep 09 15:00:00 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:00 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info" returned: 0 in 0.303s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:00 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info is being set with open permissions: ugo+rw Sep 09 15:00:00 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:00 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info Sep 09 15:00:00 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:01 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.info" returned: 0 in 0.258s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:01 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:01 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2863ece8-93bc-4271-8b74-b34ad844e29e tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-11f5d3fc-ebc0-4e26-b2cc-a84667525809-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Lock "cinder-11f5d3fc-ebc0-4e26-b2cc-a84667525809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-2f23bd5f-127c-4d2a-adef-26638f78c1d4" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-2f23bd5f-127c-4d2a-adef-26638f78c1d4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-11f5d3fc-ebc0-4e26-b2cc-a84667525809" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-11f5d3fc-ebc0-4e26-b2cc-a84667525809" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 11f5d3fc-ebc0-4e26-b2cc-a84667525809 of volume 2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[6609b8db-9c51-46ec-8ed2-0478f118b14f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:02 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 Sep 09 15:00:02 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:02 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809" returned: 0 in 0.387s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9994b0-c00c-4866-b672-0679203322cd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:02 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:02 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 Sep 09 15:00:02 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:03 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4" returned: 0 in 0.412s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:03 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 Sep 09 15:00:03 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:03 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809" returned: 0 in 0.390s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:03 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809 Sep 09 15:00:03 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:03 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4.11f5d3fc-ebc0-4e26-b2cc-a84667525809" returned: 0 in 0.256s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-11f5d3fc-ebc0-4e26-b2cc-a84667525809" released by "_delete_snapshot" :: held 1.572s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-2f23bd5f-127c-4d2a-adef-26638f78c1d4" released by "delete_snapshot" :: held 1.598s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Created reservations ['4f89b2e6-3fcf-4dd5-9c20-3e34295cced0', 'b6c372b5-083b-40cf-a1d3-408dc96bda0d', 'e7a040ce-8186-4dd3-9372-e2bc751f36e9', 'c2ab14b1-d495-4137-a36d-e4484167d0b5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:03 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 15:00:03 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-87abb36b-57c1-4383-9686-ddf210287b8e tempest-ProjectMemberTests-220436694 None] Lock "cinder-11f5d3fc-ebc0-4e26-b2cc-a84667525809-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-2f23bd5f-127c-4d2a-adef-26638f78c1d4-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Lock "cinder-2f23bd5f-127c-4d2a-adef-26638f78c1d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-2f23bd5f-127c-4d2a-adef-26638f78c1d4" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-2f23bd5f-127c-4d2a-adef-26638f78c1d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7b80b6-0c66-4440-ad7e-56978a8c16ef]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:04 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 Sep 09 15:00:04 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:04 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4" returned: 0 in 0.370s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:04 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:04 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4 Sep 09 15:00:04 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:05 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-2f23bd5f-127c-4d2a-adef-26638f78c1d4" returned: 0 in 0.269s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-2f23bd5f-127c-4d2a-adef-26638f78c1d4" released by "delete_volume" :: held 0.705s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Created reservations ['6275fd1e-6ce5-443e-b63a-89e5dfbb346d', '5d630961-a6a8-4db4-8e04-fb5f99b25cbe', '95499f5e-2746-42f8-9f21-148669b96ade', 'b9da9479-3d04-4af3-9192-ed9062b95edf'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:05 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:05 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:05 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:05 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-c5a5674b-1983-46c9-b9cd-7cc3d04e96ca tempest-ProjectMemberTests-220436694 None] Lock "cinder-2f23bd5f-127c-4d2a-adef-26638f78c1d4-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:05 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (7cc0d6e9-9901-4312-bdb4-fa2615ce24d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30ee18b-bfce-4e8e-9299-064b68379e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30ee18b-bfce-4e8e-9299-064b68379e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265424885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85a866f-1946-43ae-a5e2-6ccaf3eb1866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:06Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f66c0e-938c-4a4f-a859-b65772e15029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f66c0e-938c-4a4f-a859-b65772e15029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00024927-5b3b-4820-a016-f86b75a9609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00024927-5b3b-4820-a016-f86b75a9609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85a866f-1946-43ae-a5e2-6ccaf3eb1866', 'volume_name': 'volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491b027c-a509-48c8-9b8a-877567dfeb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491b027c-a509-48c8-9b8a-877567dfeb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039aa92c-d4dd-4adf-ad31-f2b5c8c19f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:06 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Volume a85a866f-1946-43ae-a5e2-6ccaf3eb1866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866', 'volume_size': 1} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265424885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85a866f-1946-43ae-a5e2-6ccaf3eb1866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:06Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Creating volume a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:06 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:06 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 1073741824 Sep 09 15:00:06 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:06 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 1073741824" returned: 0 in 0.507s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:06 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 Sep 09 15:00:06 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:06 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" returned: 0 in 0.293s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039aa92c-d4dd-4adf-ad31-f2b5c8c19f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8f764-25b9-4439-af8c-beb0b810ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:06 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Volume volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 (a85a866f-1946-43ae-a5e2-6ccaf3eb1866): created successfully Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f8f764-25b9-4439-af8c-beb0b810ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:06 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (7cc0d6e9-9901-4312-bdb4-fa2615ce24d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:06 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ff5f674e-0a83-4d4d-99a2-c5e93b695616 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Creating offline snapshot 843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 of volume a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[d086c88d-eb62-424b-adf2-8a693ace3f4e]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:08 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 Sep 09 15:00:08 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:08 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" returned: 0 in 0.413s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:08 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:08 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 1G Sep 09 15:00:08 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:09 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 1G" returned: 0 in 0.536s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:09 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 Sep 09 15:00:09 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:09 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" returned: 0 in 0.329s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:09 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 is being set with open permissions: ugo+rw Sep 09 15:00:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:09 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 Sep 09 15:00:09 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:09 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" returned: 0 in 0.279s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:09 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:09 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info Sep 09 15:00:09 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:10 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info" returned: 0 in 0.269s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:10 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info is being set with open permissions: ugo+rw Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:10 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info Sep 09 15:00:10 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Flow 'volume_create_manager' (6415eb55-af55-4b93-9cb8-34605e75c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1566b37f-0843-49e2-99ec-b00c02ed592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1566b37f-0843-49e2-99ec-b00c02ed592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-569201437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fcc5ce-687e-4ed2-842f-bb1da91efa8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a63203ae21048b58c85724d28b3f33b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:10Z,use_quota=True,user_id='a70c4a89fd5947ad915907428065647b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f93299-3e69-4043-9c7d-47627e800fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f93299-3e69-4043-9c7d-47627e800fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4a6c24-f752-4c56-8ea1-f7329d201e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4a6c24-f752-4c56-8ea1-f7329d201e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fcc5ce-687e-4ed2-842f-bb1da91efa8a', 'volume_name': 'volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4742514e-2f2e-4e16-b83f-fafac7e675b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4742514e-2f2e-4e16-b83f-fafac7e675b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55ece80-7552-4a2f-b0f5-32a732cde220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:10 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Volume 39fcc5ce-687e-4ed2-842f-bb1da91efa8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a', 'volume_size': 1} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:10 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.info" returned: 0 in 0.258s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-569201437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fcc5ce-687e-4ed2-842f-bb1da91efa8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a63203ae21048b58c85724d28b3f33b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:10Z,use_quota=True,user_id='a70c4a89fd5947ad915907428065647b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Creating volume 39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:10 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:10 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a 1073741824 Sep 09 15:00:10 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:10 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-833a63d6-358b-44da-bd8f-1cb514b2b291 tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 15:00:10 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a 1073741824" returned: 0 in 0.395s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:10 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:10 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a Sep 09 15:00:10 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:11 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" returned: 0 in 0.247s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55ece80-7552-4a2f-b0f5-32a732cde220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa4f2d4-d13d-478e-84c8-5e0e1c87f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:11 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Volume volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a (39fcc5ce-687e-4ed2-842f-bb1da91efa8a): created successfully Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa4f2d4-d13d-478e-84c8-5e0e1c87f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Flow 'volume_create_manager' (6415eb55-af55-4b93-9cb8-34605e75c50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:11 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7faac15c-a220-48a8-adcc-509816ff5604 tempest-SnapshotDependencyTests-1207514955 None] Created volume successfully. Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-843af2ef-3ede-44d8-8c38-1d1a53ebcdf9-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Lock "cinder-843af2ef-3ede-44d8-8c38-1d1a53ebcdf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot 843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 of volume a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Creating offline snapshot 8f99af8f-2986-4f4c-b923-9f454f7535a1 of volume 39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9276f3f-4c8c-42ec-9f66-ce46482c7ba2]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcb93d-35e1-4809-aa4c-ad8797946b68]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:11 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 Sep 09 15:00:11 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:11 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a Sep 09 15:00:11 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:11 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:11 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" returned: 0 in 0.367s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c3c0b1-5b1e-4ea7-a130-2f4b318468dd]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:11 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:11 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 1G Sep 09 15:00:11 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:12 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 Sep 09 15:00:12 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:12 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:12 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 1G" returned: 0 in 0.394s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:12 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 Sep 09 15:00:12 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:12 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 Sep 09 15:00:12 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:12 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1" returned: 0 in 0.302s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:12 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 is being set with open permissions: ugo+rw Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:12 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" returned: 0 in 0.342s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:12 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 Sep 09 15:00:12 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:12 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9 Sep 09 15:00:12 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:12 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:12 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866.843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" returned: 0 in 0.237s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1" returned: 0 in 0.280s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-843af2ef-3ede-44d8-8c38-1d1a53ebcdf9" released by "_delete_snapshot" :: held 1.404s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=172,cinder:SELECT=141,cinder:INSERT=46,cinder:DELETE=13 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=192,cinder:SELECT=140,cinder:INSERT=52,cinder:DELETE=17 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" released by "delete_snapshot" :: held 1.442s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:12 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:12 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info Sep 09 15:00:12 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Created reservations ['76059a6a-cbd1-4993-97cd-76132a1b5657', 'bd83df77-630a-49f0-a665-225c12243d1c', '1832671e-dc63-408e-9ba6-f284431bc0ed', 'f57e8bde-8a77-4d94-aae9-f65a87e478eb'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b341ad4f-5abf-4fcf-a8b9-cfc21346095e tempest-ProjectMemberTests-220436694 None] Lock "cinder-843af2ef-3ede-44d8-8c38-1d1a53ebcdf9-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:13 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:13 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info is being set with open permissions: ugo+rw Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:13 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info Sep 09 15:00:13 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:13 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.info" returned: 0 in 0.254s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:13 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1be1ccd4-ac6e-4667-a091-209cb986aa13 tempest-SnapshotDependencyTests-1207514955 None] Create snapshot completed successfully Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-a85a866f-1946-43ae-a5e2-6ccaf3eb1866-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-a85a866f-1946-43ae-a5e2-6ccaf3eb1866-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[3014c1fc-93e0-46ab-84ba-0ef428e19a07]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:13 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:13 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 Sep 09 15:00:13 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:14 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" returned: 0 in 0.383s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:14 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866 Sep 09 15:00:14 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Flow 'volume_create_manager' (8d6ada80-b67e-41b5-91d7-a17feac28e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eedd30d-91f6-4f39-b639-1a04ad8cf229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eedd30d-91f6-4f39-b639-1a04ad8cf229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4de945a-b549-498d-9aaf-e3153bdff5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a63203ae21048b58c85724d28b3f33b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f99af8f-2986-4f4c-b923-9f454f7535a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:14Z,use_quota=True,user_id='a70c4a89fd5947ad915907428065647b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af8d337-6c23-48c0-8c59-7c3bb46cc056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af8d337-6c23-48c0-8c59-7c3bb46cc056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfaa14-a242-456d-aa76-39408af635aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfaa14-a242-456d-aa76-39408af635aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4de945a-b549-498d-9aaf-e3153bdff5c5', 'volume_name': 'volume-b4de945a-b549-498d-9aaf-e3153bdff5c5', 'volume_size': 1, 'snapshot_id': '8f99af8f-2986-4f4c-b923-9f454f7535a1'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da4f925-48f2-4a4e-8c53-980c48e1f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da4f925-48f2-4a4e-8c53-980c48e1f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ffd978-8192-473e-aaed-e188ff725b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:14 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Volume b4de945a-b549-498d-9aaf-e3153bdff5c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4de945a-b549-498d-9aaf-e3153bdff5c5', 'volume_size': 1, 'snapshot_id': '8f99af8f-2986-4f4c-b923-9f454f7535a1'} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-quobyte-8f99af8f-2986-4f4c-b923-9f454f7535a1-b4de945a-b549-498d-9aaf-e3153bdff5c5" by "_create_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-8f99af8f-2986-4f4c-b923-9f454f7535a1-b4de945a-b549-498d-9aaf-e3153bdff5c5" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Creating volume b4de945a-b549-498d-9aaf-e3153bdff5c5 from snapshot 8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-quobyte-b4de945a-b549-498d-9aaf-e3153bdff5c5" by "_copy_volume_from_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-b4de945a-b549-498d-9aaf-e3153bdff5c5" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] snapshot: 8f99af8f-2986-4f4c-b923-9f454f7535a1, volume: b4de945a-b549-498d-9aaf-e3153bdff5c5, {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:14 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fced4068-5ad3-4f9e-9cc8-490371e1ce7d]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a85a866f-1946-43ae-a5e2-6ccaf3eb1866" released by "delete_volume" :: held 0.724s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Created reservations ['60775726-f3ce-4983-b8c3-f524d5af8b5d', '7fe9e0fa-2d60-4f13-824f-f063d91bc02a', 'ad776123-e2b1-4899-99df-ba88a9b7491d', '9ba92327-19b2-40e1-acbc-7d641b44035c'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:14 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 Sep 09 15:00:14 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:14 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:14 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:14 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:14 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.251s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:14 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[378564c9-1fa1-48f9-aae1-63880261c725]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:14 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-7ef7872a-64ef-4d9e-8e10-067d4a1f8ae3 tempest-ProjectMemberTests-220436694 None] Lock "cinder-a85a866f-1946-43ae-a5e2-6ccaf3eb1866-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:14 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a Sep 09 15:00:14 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:15 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" returned: 0 in 0.385s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Creating direct copy from snapshot {{(pid=87325) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.utils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Path /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 not found in is_blk_device check {{(pid=87325) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:15 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 Sep 09 15:00:15 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (33bd5590-b077-451d-b86b-fba60edfa832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d16818-8a92-4ed4-9e5c-590ef186d0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d16818-8a92-4ed4-9e5c-590ef186d0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248166171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3410adf-81b4-4521-8ef4-7f9e2d0f7083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:15Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d463b20c-50b2-4cf8-8388-ec798590de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d463b20c-50b2-4cf8-8388-ec798590de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08171863-9440-4e50-9396-13110f86772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08171863-9440-4e50-9396-13110f86772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3410adf-81b4-4521-8ef4-7f9e2d0f7083', 'volume_name': 'volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3d675d-1efb-44ff-85d8-d1ead14c8850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3d675d-1efb-44ff-85d8-d1ead14c8850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee829ba8-b912-46ef-9d7d-0127e9e38c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:15 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Volume a3410adf-81b4-4521-8ef4-7f9e2d0f7083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083', 'volume_size': 1} Sep 09 15:00:15 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:19 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5" returned: 0 in 4.054s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.image.image_utils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Image conversion details: src /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 {{(pid=87325) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 15:00:19 devstack cinder-volume[87325]: INFO cinder.image.image_utils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Converted 1024.00 MB image at 252.54 MB/s Sep 09 15:00:19 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 is being set with open permissions: ugo+rw Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:19 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 Sep 09 15:00:19 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:19 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5" returned: 0 in 0.238s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-b4de945a-b549-498d-9aaf-e3153bdff5c5" released by "_copy_volume_from_snapshot" :: held 5.142s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-8f99af8f-2986-4f4c-b923-9f454f7535a1-b4de945a-b549-498d-9aaf-e3153bdff5c5" released by "_create_volume_from_snapshot" :: held 5.202s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.217s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.179s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248166171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3410adf-81b4-4521-8ef4-7f9e2d0f7083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e1a792d2174acc8353827fd495b912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:15Z,use_quota=True,user_id='86ebcdae915c41b98c41cc6ba754601a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Creating volume a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:19 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:19 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 1073741824 Sep 09 15:00:19 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ffd978-8192-473e-aaed-e188ff725b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4de945a-b549-498d-9aaf-e3153bdff5c5', 'volume_size': 1, 'snapshot_id': '8f99af8f-2986-4f4c-b923-9f454f7535a1'}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a57d4-93bc-4901-a154-73bf02c3585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:19 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Volume volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 (b4de945a-b549-498d-9aaf-e3153bdff5c5): created successfully Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a57d4-93bc-4901-a154-73bf02c3585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Flow 'volume_create_manager' (8d6ada80-b67e-41b5-91d7-a17feac28e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:19 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-08f4217c-e009-4a88-831e-c6fa89ba9f35 tempest-SnapshotDependencyTests-1207514955 None] Created volume successfully. Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-8f99af8f-2986-4f4c-b923-9f454f7535a1-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-8f99af8f-2986-4f4c-b923-9f454f7535a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-quobyte-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-quobyte-8f99af8f-2986-4f4c-b923-9f454f7535a1" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-8f99af8f-2986-4f4c-b923-9f454f7535a1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Deleting offline snapshot 8f99af8f-2986-4f4c-b923-9f454f7535a1 of volume 39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] snapshot_file for this snap is: volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a2aa5f-1719-418f-a1c5-605fbbbc1591]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:19 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:20 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:20 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 Sep 09 15:00:20 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 1073741824" returned: 0 in 0.485s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:20 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 Sep 09 15:00:20 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:20 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1" returned: 0 in 0.360s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a7ce7-dae2-40df-8f2b-745d781f0716]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:20 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" returned: 0 in 0.252s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee829ba8-b912-46ef-9d7d-0127e9e38c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfeecd0-1382-46c6-8a53-03e29eb73277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:20 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Volume volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 (a3410adf-81b4-4521-8ef4-7f9e2d0f7083): created successfully Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfeecd0-1382-46c6-8a53-03e29eb73277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Flow 'volume_create_manager' (33bd5590-b077-451d-b86b-fba60edfa832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:20 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b06b1d89-2d92-493c-9210-9dcd20a980a7 tempest-ProjectMemberTests-220436694 None] Created volume successfully. Sep 09 15:00:20 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a Sep 09 15:00:20 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:20 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" returned: 0 in 0.539s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:20 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 Sep 09 15:00:20 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Creating offline snapshot ec27d302-60f9-4ebb-a973-d0977c2290ac of volume a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c206bd7-9867-4c9a-a6ce-bea54a56dad5]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:20 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:21 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 Sep 09 15:00:21 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:21 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1" returned: 0 in 0.350s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:21 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1 Sep 09 15:00:21 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:21 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" returned: 0 in 0.369s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac 1G {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:21 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac 1G Sep 09 15:00:21 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:21 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a.8f99af8f-2986-4f4c-b923-9f454f7535a1" returned: 0 in 0.260s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-8f99af8f-2986-4f4c-b923-9f454f7535a1" released by "_delete_snapshot" :: held 1.604s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" released by "delete_snapshot" :: held 1.630s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Created reservations ['16ac506c-4832-4c42-93a7-70c4ffb1086a', '11a9aa76-54ea-4692-88f9-d27693a0e787', 'ce558983-0176-4795-9860-c1458f7d767b', 'a678efe5-f83a-43ae-85c7-4492c763dd19'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:21 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Delete snapshot completed successfully. Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-f4390534-27d5-48be-b372-ab82463f9878 tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-8f99af8f-2986-4f4c-b923-9f454f7535a1-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:21 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac 1G" returned: 0 in 0.415s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:21 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac Sep 09 15:00:21 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:21 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-39fcc5ce-687e-4ed2-842f-bb1da91efa8a-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:22 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 -F qcow2 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac" returned: 0 in 0.299s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:22 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac is being set with open permissions: ugo+rw Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-39fcc5ce-687e-4ed2-842f-bb1da91efa8a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:22 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac Sep 09 15:00:22 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-quobyte-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b6613-208b-45db-912a-ba27e384fe8f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:22 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a Sep 09 15:00:22 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:22 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac" returned: 0 in 0.275s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:22 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info Sep 09 15:00:22 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:22 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" returned: 0 in 0.386s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:22 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a Sep 09 15:00:22 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:22 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info" returned: 0 in 0.277s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:22 devstack cinder-volume[87325]: WARNING cinder.volume.drivers.remotefs [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info is being set with open permissions: ugo+rw Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:22 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info Sep 09 15:00:22 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:22 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" returned: 0 in 0.256s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-39fcc5ce-687e-4ed2-842f-bb1da91efa8a" released by "delete_volume" :: held 0.702s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Created reservations ['84daf801-5242-424c-98e0-03fd807b4e53', '7809d1f2-97db-419e-99a1-0bc602068431', '98835548-a4b1-4734-936a-490330bdf964', 'adff6c7c-f20b-4375-b7eb-41a910ff8ce2'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:22 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.info" returned: 0 in 0.259s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:22 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-456210ea-7777-48bc-b5b6-22fae3679187 tempest-ProjectMemberTests-220436694 None] Create snapshot completed successfully Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:22 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:22 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:22 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-b4de945a-b549-498d-9aaf-e3153bdff5c5-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-b4de945a-b549-498d-9aaf-e3153bdff5c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:23 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.267s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:23 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Deleted volume successfully. Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "cinder-quobyte-b4de945a-b549-498d-9aaf-e3153bdff5c5" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-1a64989a-5a5a-45cd-b1cf-3b74f805447b tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-39fcc5ce-687e-4ed2-842f-bb1da91efa8a-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-b4de945a-b549-498d-9aaf-e3153bdff5c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8ced3c-24ea-45e7-8920-b2ee28ee633c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:23 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 Sep 09 15:00:23 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:23 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5" returned: 0 in 0.377s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:23 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5 Sep 09 15:00:23 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:23 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-b4de945a-b549-498d-9aaf-e3153bdff5c5" returned: 0 in 0.244s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-quobyte-b4de945a-b549-498d-9aaf-e3153bdff5c5" released by "delete_volume" :: held 0.662s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:23 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Created reservations ['a89d7053-2e44-4002-b875-a4a4d4e170ff', '61c4381e-5034-4eaf-875f-1a64d5958107', '34646c79-8291-4694-9986-d36244801b5d', 'fbc734e8-4c20-45df-8020-5407d62bbb57'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:24 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:24 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-ec27d302-60f9-4ebb-a973-d0977c2290ac-delete_snapshot" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-ec27d302-60f9-4ebb-a973-d0977c2290ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" by "delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-ec27d302-60f9-4ebb-a973-d0977c2290ac" by "_delete_snapshot" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-ec27d302-60f9-4ebb-a973-d0977c2290ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Deleting offline snapshot ec27d302-60f9-4ebb-a973-d0977c2290ac of volume a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] snapshot_file for this snap is: volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac {{(pid=87325) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f4b9b-3d1f-4e7f-84db-30d5eeabeb0c]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:24 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.272s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:24 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Deleted volume successfully. Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-42e6c4e9-8c8c-4593-8892-2aaa255164af tempest-SnapshotDependencyTests-1207514955 None] Lock "cinder-b4de945a-b549-498d-9aaf-e3153bdff5c5-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:24 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac Sep 09 15:00:24 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:24 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac" returned: 0 in 0.388s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87325) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3a7b7f-190d-4faa-b025-9961755a584a]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:24 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:24 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 Sep 09 15:00:24 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:25 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" returned: 0 in 0.373s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:25 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac Sep 09 15:00:25 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:25 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac" returned: 0 in 0.368s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:25 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac Sep 09 15:00:25 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:25 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083.ec27d302-60f9-4ebb-a973-d0977c2290ac" returned: 0 in 0.250s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-ec27d302-60f9-4ebb-a973-d0977c2290ac" released by "_delete_snapshot" :: held 1.486s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" released by "delete_snapshot" :: held 1.510s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Created reservations ['63cfff31-91bd-4605-8c91-e9ca4a4159fd', '41421924-32b5-46ab-af64-8b265c9a083e', '7ca1ab01-5700-413a-9cf1-2e7f3b78c801', 'd6b0bfd4-109c-404e-8e6a-948588356652'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:25 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Delete snapshot completed successfully. Sep 09 15:00:25 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-8d5d7233-8cc3-430b-8635-a4979ed429a4 tempest-ProjectMemberTests-220436694 None] Lock "cinder-ec27d302-60f9-4ebb-a973-d0977c2290ac-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-a3410adf-81b4-4521-8ef4-7f9e2d0f7083-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Lock "cinder-a3410adf-81b4-4521-8ef4-7f9e2d0f7083-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Acquiring lock "cinder-quobyte-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" acquired by "delete_volume" :: waited 0.018s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb82d29-a72e-4adb-a3ec-251b04ce9283]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:26 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 Sep 09 15:00:26 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:26 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" returned: 0 in 0.383s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:26 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:26 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083 Sep 09 15:00:26 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:27 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" returned: 0 in 0.252s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Lock "cinder-quobyte-a3410adf-81b4-4521-8ef4-7f9e2d0f7083" released by "delete_volume" :: held 0.692s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Created reservations ['d3c0813f-45da-4592-9950-3f99c49ee010', 'eb207ccb-1a09-4eb4-8e7e-a60bbdad5f81', '0997a210-a62c-4345-a1c7-e72c8cfed5ee', '88352960-829e-4232-9b0c-5db46ece4ca5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:27 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:27 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:27 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.242s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:27 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Deleted volume successfully. Sep 09 15:00:27 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-307c29f7-7194-4b3a-8ee5-2dab9f702a1a tempest-ProjectMemberTests-220436694 None] Lock "cinder-a3410adf-81b4-4521-8ef4-7f9e2d0f7083-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:37 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=52,cinder:UPDATE=52,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 15:00:37 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=36,cinder:INSERT=16,cinder:UPDATE=62,cinder:DELETE=5 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (3dd27916-ad0f-4be0-a645-2ac50eda1803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb862a48-9b4a-4023-9616-4e22e073fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb862a48-9b4a-4023-9616-4e22e073fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086488067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e804951-733e-4537-8aa9-c8d41632acfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:44Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5d10f8-2704-4534-ad90-5e910a61d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5d10f8-2704-4534-ad90-5e910a61d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188087d-5f6c-4a27-8cea-e6fd3207d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1188087d-5f6c-4a27-8cea-e6fd3207d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e804951-733e-4537-8aa9-c8d41632acfe', 'volume_name': 'volume-1e804951-733e-4537-8aa9-c8d41632acfe', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb5a92c-417f-4a2e-957f-38083e521aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb5a92c-417f-4a2e-957f-38083e521aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b409747c-edb7-40e1-bdc5-5131f5cbf7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:44 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Volume 1e804951-733e-4537-8aa9-c8d41632acfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e804951-733e-4537-8aa9-c8d41632acfe', 'volume_size': 1} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086488067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e804951-733e-4537-8aa9-c8d41632acfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:44Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Creating volume 1e804951-733e-4537-8aa9-c8d41632acfe {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:44 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:44 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe 1073741824 Sep 09 15:00:44 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:44 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe 1073741824" returned: 0 in 0.402s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:44 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:44 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe Sep 09 15:00:44 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:45 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b409747c-edb7-40e1-bdc5-5131f5cbf7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e804951-733e-4537-8aa9-c8d41632acfe', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc01d86-2ccd-4f97-b7fd-07f31f677137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:45 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Volume volume-1e804951-733e-4537-8aa9-c8d41632acfe (1e804951-733e-4537-8aa9-c8d41632acfe): created successfully Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc01d86-2ccd-4f97-b7fd-07f31f677137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (3dd27916-ad0f-4be0-a645-2ac50eda1803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:45 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ff721d15-f94a-424f-8ab6-5b299055a34e tempest-ProjectReaderTests-2141508228 None] Created volume successfully. Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-1e804951-733e-4537-8aa9-c8d41632acfe-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-1e804951-733e-4537-8aa9-c8d41632acfe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-quobyte-1e804951-733e-4537-8aa9-c8d41632acfe" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-1e804951-733e-4537-8aa9-c8d41632acfe" acquired by "delete_volume" :: waited 0.014s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a56532-d46a-4c25-98cd-76330f830701]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:45 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:45 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe Sep 09 15:00:45 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:46 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe" returned: 0 in 0.349s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:46 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe Sep 09 15:00:46 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:46 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-1e804951-733e-4537-8aa9-c8d41632acfe" returned: 0 in 0.240s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-1e804951-733e-4537-8aa9-c8d41632acfe" released by "delete_volume" :: held 0.629s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Created reservations ['ae503f4a-4429-4306-9c39-1afd0d3a9671', '18075f47-d8fb-46a6-9e69-b361a9880a30', '98f8e73e-17c7-4dbd-a68e-e3df02413880', '76f7f724-d8de-49e6-9ea5-698b9eb77f56'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:46 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:46 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:46 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.257s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:46 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Deleted volume successfully. Sep 09 15:00:46 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-b018b06a-a68e-4ebe-9ff8-b2023484fda9 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-1e804951-733e-4537-8aa9-c8d41632acfe-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (65105914-1d48-48d2-a29a-3bd06cf0b9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d4df5d-d5a3-4af5-b5a9-d49bccb5d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d4df5d-d5a3-4af5-b5a9-d49bccb5d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913132456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d1ffa8-a3ab-49a3-9929-0330aac760ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:47Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3151e8d9-ca81-4222-881e-5dc8bb512f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3151e8d9-ca81-4222-881e-5dc8bb512f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2cfd2c-8231-4df2-a811-a7c3ff9f6aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2cfd2c-8231-4df2-a811-a7c3ff9f6aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d1ffa8-a3ab-49a3-9929-0330aac760ac', 'volume_name': 'volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104d67e-c04a-4745-ad17-85c4f1963cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104d67e-c04a-4745-ad17-85c4f1963cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dad428-c063-44e9-a92d-8100cb7241e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Volume 56d1ffa8-a3ab-49a3-9929-0330aac760ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac', 'volume_size': 1} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913132456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d1ffa8-a3ab-49a3-9929-0330aac760ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:47Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Creating volume 56d1ffa8-a3ab-49a3-9929-0330aac760ac {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:47 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:47 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac 1073741824 Sep 09 15:00:47 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:47 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac 1073741824" returned: 0 in 0.397s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:47 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac Sep 09 15:00:47 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:47 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac" returned: 0 in 0.252s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dad428-c063-44e9-a92d-8100cb7241e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecf45ae-8146-4d51-8c03-32950a6f2e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:47 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Volume volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac (56d1ffa8-a3ab-49a3-9929-0330aac760ac): created successfully Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecf45ae-8146-4d51-8c03-32950a6f2e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:47 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (65105914-1d48-48d2-a29a-3bd06cf0b9d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:48 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-0635b525-3cda-40d2-af98-d76f186160ba tempest-ProjectReaderTests-2141508228 None] Created volume successfully. Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-56d1ffa8-a3ab-49a3-9929-0330aac760ac-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-56d1ffa8-a3ab-49a3-9929-0330aac760ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-quobyte-56d1ffa8-a3ab-49a3-9929-0330aac760ac" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-56d1ffa8-a3ab-49a3-9929-0330aac760ac" acquired by "delete_volume" :: waited 0.017s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e2ed66-039e-42fd-ab01-58501d94204f]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:48 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac Sep 09 15:00:48 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:48 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac" returned: 0 in 0.347s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:48 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac Sep 09 15:00:48 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:48 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-56d1ffa8-a3ab-49a3-9929-0330aac760ac" returned: 0 in 0.239s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:48 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-56d1ffa8-a3ab-49a3-9929-0330aac760ac" released by "delete_volume" :: held 0.623s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Created reservations ['ed947578-c799-4d26-bce6-84367e9663ca', 'e01b9a01-0a39-4202-a52d-e7f44c949a2b', 'c84d426a-e2e6-41f8-80bd-f181cd8b00d7', '1cdba3f5-0920-4f28-a48a-f68b33eca62e'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:49 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:49 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:49 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.258s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:49 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Deleted volume successfully. Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-6ade61c9-20b4-4949-b45f-bac0f3ec9405 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-56d1ffa8-a3ab-49a3-9929-0330aac760ac-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (b8ab995e-da7a-4ddb-b407-a1d2f98f4b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d1631c-34fd-4bb4-8952-d076e4260bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d1631c-34fd-4bb4-8952-d076e4260bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074690296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd2c942-7239-4be4-8347-25202d2d33d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:50Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec19a522-6073-4895-803b-088331b178cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec19a522-6073-4895-803b-088331b178cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d166dd-5ade-4bc8-8caa-9d3ba53929e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d166dd-5ade-4bc8-8caa-9d3ba53929e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd2c942-7239-4be4-8347-25202d2d33d8', 'volume_name': 'volume-6cd2c942-7239-4be4-8347-25202d2d33d8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a60a2a3-aa58-427b-b2cc-82b79bb6543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a60a2a3-aa58-427b-b2cc-82b79bb6543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1e3eec-739d-453f-b46c-0bea98c2f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:49 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Volume 6cd2c942-7239-4be4-8347-25202d2d33d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd2c942-7239-4be4-8347-25202d2d33d8', 'volume_size': 1} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074690296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd2c942-7239-4be4-8347-25202d2d33d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:50Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Creating volume 6cd2c942-7239-4be4-8347-25202d2d33d8 {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:49 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:49 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:49 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 1073741824 Sep 09 15:00:49 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:50 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 1073741824" returned: 0 in 0.397s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:50 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 Sep 09 15:00:50 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:50 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8" returned: 0 in 0.236s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1e3eec-739d-453f-b46c-0bea98c2f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd2c942-7239-4be4-8347-25202d2d33d8', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac546e8-db70-4150-9096-74681f017bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:50 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Volume volume-6cd2c942-7239-4be4-8347-25202d2d33d8 (6cd2c942-7239-4be4-8347-25202d2d33d8): created successfully Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac546e8-db70-4150-9096-74681f017bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (b8ab995e-da7a-4ddb-b407-a1d2f98f4b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:50 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-17e1fc04-db11-49c4-86d8-c446727c214e tempest-ProjectReaderTests-2141508228 None] Created volume successfully. Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-6cd2c942-7239-4be4-8347-25202d2d33d8-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-6cd2c942-7239-4be4-8347-25202d2d33d8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-quobyte-6cd2c942-7239-4be4-8347-25202d2d33d8" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-6cd2c942-7239-4be4-8347-25202d2d33d8" acquired by "delete_volume" :: waited 0.016s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be53e89-e32d-438f-a2c6-00a7356acd85]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:50 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:51 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 Sep 09 15:00:51 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:51 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8" returned: 0 in 0.352s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:51 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8 Sep 09 15:00:51 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:51 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-6cd2c942-7239-4be4-8347-25202d2d33d8" returned: 0 in 0.239s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-6cd2c942-7239-4be4-8347-25202d2d33d8" released by "delete_volume" :: held 0.630s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Created reservations ['2674b1c8-5345-48d4-b789-16a3e06fce35', 'fee6555e-8805-478f-aca4-79e59497e0ad', 'ef9b7e6d-e8b5-4dc9-8e8d-0467a281405e', '1ba44856-ba3f-417e-bb27-48d78f227ee6'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:51 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:51 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:51 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.247s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:51 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Deleted volume successfully. Sep 09 15:00:51 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-ea3b6ce7-6408-4487-a7c8-aaf008b9d457 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-6cd2c942-7239-4be4-8347-25202d2d33d8-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:52 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:52 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87325) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (c11de14d-9667-4f7f-8996-5893906bd3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d7cae1-c9bb-4f2f-b031-6c73b0f1a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d7cae1-c9bb-4f2f-b031-6c73b0f1a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137476545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:52Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b36f31e-2801-4e0a-afa4-1526df7b38a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b36f31e-2801-4e0a-afa4-1526df7b38a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df40c331-7b9d-430a-b774-d1041e25f652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df40c331-7b9d-430a-b774-d1041e25f652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e', 'volume_name': 'volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d95975-48ed-47e5-acfc-4605393b496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d95975-48ed-47e5-acfc-4605393b496e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9098c95d-edda-4d3a-80da-2afd33f7cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:52 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Volume 5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e', 'volume_size': 1} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T13:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137476545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a18efbbe743bcb0f803481c5e42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T13:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T13:00:52Z,use_quota=True,user_id='80b1490d4f02498287fa276d65a3a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c348645-d661-4a7b-b814-70a7a6a42cd5),volume_type_id=0c348645-d661-4a7b-b814-70a7a6a42cd5)}" {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.remotefs [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Creating volume 5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e {{(pid=87325) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:52 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Selected osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 as target Quobyte volume. {{(pid=87325) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 15:00:52 devstack cinder-volume[87325]: INFO cinder.volume.drivers.remotefs [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] casted to osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31 Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e 1073741824 {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.283s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG oslo_service.periodic_task [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] Running periodic task VolumeManager._thread_info {{(pid=87325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread count: 29 {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 15:00:52 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-8f98134d-d006-4731-be2e-6d842cccc50e None None] thread info: [<_MainThread(MainThread, started 134867201613952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 15:00:52 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e 1073741824 Sep 09 15:00:52 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:53 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e 1073741824" returned: 0 in 0.422s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:53 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e Sep 09 15:00:53 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:53 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e" returned: 0 in 0.259s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'} {{(pid=87325) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9098c95d-edda-4d3a-80da-2afd33f7cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e', 'volume_size': 1}' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba6b33d-276c-4ae7-9758-0482a83dc4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 15:00:53 devstack cinder-volume[87325]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Volume volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e (5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e): created successfully Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba6b33d-276c-4ae7-9758-0482a83dc4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87325) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Flow 'volume_create_manager' (c11de14d-9667-4f7f-8996-5893906bd3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87325) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 15:00:53 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-5c6e7503-1a29-4827-b533-76ac3b0c7863 tempest-ProjectReaderTests-2141508228 None] Created volume successfully. Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e-delete_volume" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "cinder-quobyte-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e" by "delete_volume" {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e" acquired by "delete_volume" :: waited 0.015s {{(pid=87325) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a78658-f745-45b6-8c68-6d4418104442]: (4, 'qcow2') {{(pid=88265) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:53 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e Sep 09 15:00:53 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:53 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e" returned: 0 in 0.348s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:53 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:53 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e Sep 09 15:00:53 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:54 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e/volume-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e" returned: 0 in 0.246s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-quobyte-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e" released by "delete_volume" :: held 0.632s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG cinder.quota [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Created reservations ['40ebb530-7980-4f31-88c6-4790a8ab1ccd', '44a933a6-049b-4c02-9275-d7a3c04af043', 'e71505b6-d289-4daf-91fa-0c8dda41abd1', '6a6b73f8-ecd8-416b-b76e-d923b0d82dc5'] {{(pid=87325) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31': None} {{(pid=87325) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d0ca2098-edd3-4580-a81c-c23f87f4bb31'] {{(pid=87325) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.lockutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87325) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 15:00:54 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e Sep 09 15:00:54 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 15:00:54 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG oslo_concurrency.processutils [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/99fd9ceabf3bb25be975632759ef849e" returned: 0 in 0.234s {{(pid=87325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG cinder.manager [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Notifying Schedulers of capabilities ... {{(pid=87325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 15:00:54 devstack cinder-volume[87325]: INFO cinder.volume.manager [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Deleted volume successfully. Sep 09 15:00:54 devstack cinder-volume[87325]: DEBUG cinder.coordination [None req-2dd1c6fa-a793-43fc-ba41-3763825d3ad7 tempest-ProjectReaderTests-2141508228 None] Lock "cinder-5f5a33a9-905d-4dbf-99db-d7a02c6cdc0e-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87325) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 15:01:04 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:SELECT=32,cinder:UPDATE=40,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 15:01:04 devstack cinder-volume[87325]: DEBUG dbcounter [-] [87325] Writing DB stats cinder:UPDATE=48,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}